1、查找文本中的模式
search()函数取模式和要扫描的文本作为输入,找到这个模式时就返回一个match对象。如果没有找到模式,search()就返回None。
每个match对象包含有关匹配性质的信息,包含原输入字符串,所使用的正则表达式以及模式在原字符串出现的位置。
import re
pattern = 'this'
text = 'Does this text match the pattern?'
match = re.search(pattern, text)
s = match.start()
e = match.end()
print('Found "{}"\nin "{}"\nfrom {} to ("{}")'.format(match.re.pattern, match.string, s, e, text[s:e]))
_____________________输出___________________________________________
Found "this"
in "Does this text match the pattern?"
from 5 to ("9")
start()和end()方法可以提供字符串中的相应索引,指示与模式匹配的文本在字符串中出现的位置。
2、编译表达式
尽管re包括模块级函数,可以处理作为文本字符串的正则表达式,但是对于程序频繁使用的表达式而言,编译它们会更为高效。compile()函数会把一个表达式字符串转换为一个Regex0bject。
import re
regexes = [
re.compile(p)
for p in ['this', 'that']
]
text = 'Does this text match the pattern?'
print('Text: {!r}\n'.format(text))
for regex in regexes:
print('Seeking "{}" ->'.format(regex.pattern),end=' ')
if regex.search(text):
print('match')
else:
print('no match')
_________________________输出_________________________________
Text: 'Does this text match the pattern?'
Seeking "this" -> match
Seeking "that" -> no match
模块级函数会维护一个包含已编译表达式的缓存,不过这个缓存的大小是有限的,另外直接使用已编译表达式可以避免与缓存查找相关的开销。使用已编译表达式的另一个好处为,通过在加载模块时预编译所有的表达式,可以把编译工作转移到应用开始时,而不是当程序响应一个用户动作时才编译。
3、多重匹配
使用search()来查找字面量文本字符串的单个实例,findall()函数会返回输入中与模式匹配而且不重叠的所有子串。
import re
text = 'abbaaabbbbaaaaaa'
pattern = 'ab'
for match in re.findall(pattern, text):
print('Found {!r}'.format(match))
_______________________输出_____________________
Found 'ab'
Found 'ab'
finditer()返回一个迭代器,它会生成Match实例,而不是像findall()那样返回字符串。
import re
text = 'abbaaabbbbaaaaaa'
pattern = 'ab'
for match in re.finditer(pattern, text):
s = match.start()
e = match.end()
print('Found {!r} at {:d}:{:d}'.format(text[s:e],s,e))
_______________________输出_______________________________
Found 'ab' at 0:2
Found 'ab' at 5:7
4、模式语法
正则表达式还支持更加强大的模式。模式可以重复,可以锚定到输入中不同的逻辑位置,可以用紧凑的形式表述而不需要在模式中提取每一个重复的字符
import re
def test_pattern(text,patterns):
for pattern, desc in patterns:
print("'{}' ({})\n".format(pattern,desc))
print(" '{}'".format(text))
for match in re.finditer(pattern, text):
s = match.start()
e = match.end()
substr = text[s:e]
n_backslashes = text[:s].count('\\')
prefix = '.' * (s+n_backslashes)
print(" {}'{}'".format(prefix,substr))
print()
return
if __name__ == "__main__":
test_pattern('abbaaabbbbaaaaaa',[('ab',"'a' follow by 'b'"),])
________________________输出_______________________________________
'ab' ('a' follow by 'b')
'abbaaabbbbaaaaaa'
'ab'
.....'ab'
输出显示输入文本以及输入中与模式匹配的各个部分的子串区间。
重复
模式中有5种表示重复的方法。模式后面如果有元字符*,则表示重复0次或多次(允许一个模式重复0次是指这个模式即使不出现也可以匹配)。如果把*替换为+,那么模式必须至少出现一次才能匹配。使用?表示模式出现0次或1次。如果要制定出现次数,需要在模式后面使用{m},m表示模式应重复的次数。最后,如果要允许一个可变但有限的重复次数,那么可以使用{m,n},这里m是最少重复次数,n是最大重复次数。如果省略n({m,}),则表示值必须至少出现m次,但没有最大限制。
test_pattern('abbaabbba',[('ab*','a followed by zero or more b'),
('ab+','a followed by one or more b'),
('ab?','a followed by zero or one b'),
('ab{3}','a followed by three b'),
('ab{2,3}','a followed by two or three b')],
)
__________________________输出__________________________________
'ab*' (a followed by zero or more b)
'abbaabbba'
'abb'
...'a'
....'abbb'
........'a'
'ab+' (a followed by one or more b)
'abbaabbba'
'abb'
....'abbb'
'ab?' (a followed by zero or one b)
'abbaabbba'
'ab'
...'a'
....'ab'
........'a'
'ab{3}' (a followed by three b)
'abbaabbba'
....'abbb'
'ab{2,3}' (a followed by two or three b)
'abbaabbba'
'abb'
....'abbb'
处理重复指令时,re在匹配模式时通常会尽可能多地消费输入。这种像“贪心”的行为可能会导致单个匹配减少,或匹配结果包含比预想更多的输入文本。可以在重复指令后面加?来关闭贪心行为。
test_pattern('abbaabbba',[('ab*?','a followed by zero or more b'),
('ab+?','a followed by one or more b'),
('ab??','a followed by zero or one b'),
('ab{3}?','a followed by three b'),
('ab{2,3}?','a followed by two or three b')],
)
______________________________输出________________________________
'ab*?' (a followed by zero or more b)
'abbaabbba'
'a'
...'a'
....'a'
........'a'
'ab+?' (a followed by one or more b)
'abbaabbba'
'ab'
....'ab'
'ab??' (a followed by zero or one b)
'abbaabbba'
'a'
...'a'
....'a'
........'a'
'ab{3}?' (a followed by three b)
'abbaabbba'
....'abbb'
'ab{2,3}?' (a followed by two or three b)
'abbaabbba'
'abb'
....'abb'
字符集
字符集是一组字符,包含可以与模式中当前位置匹配的所有字符。例如,[a,b]可以匹配为a或b
test_pattern('abbaabbba',[('[ab]','either a or b'),
('a[ab]+','a followed by one or more a or b'),
('a[ab]+?','a followed by one or more a or b, not greedy')],
)
________________________________输出__________________________________________
'[ab]' (either a or b)
'abbaabbba'
'a'
.'b'
..'b'
...'a'
....'a'
.....'b'
......'b'
.......'b'
........'a'
'a[ab]+' (a followed by one or more a or b)
'abbaabbba'
'abbaabbba'
'a[ab]+?' (a followed by one or more a or b, not greedy)
'abbaabbba'
'ab'
...'aa'
尖字符(^)代表要查找不在这个尖字符后面的集合中的字符
test_pattern('This is some text -- with punctuation',[('[^-. ]+','sequences without -, ., or space')],)
__________________________________输出__________________________________
'[^-. ]+' (sequences without -, ., or space)
'This is some text -- with punctuation'
'This'
.....'is'
........'some'
.............'text'
.....................'with'
..........................'punctuation'
利用字符区间来定义一个字符集
test_pattern('This is some text -- with punctuation',
[('[a-z]+','sequences of lowercase letters'),
('[A-Z]+','sequences of uppercase letters'),
('[a-zA-Z]+','sequences of lower- or uppercase letters'),
('[a-z][A-Z]+','one uppercase followed by lowercase')],
)
————————————————————————————————————输出————————————————————————————————————
'[a-z]+' (sequences of lowercase letters)
'This is some text -- with punctuation'
.'his'
.....'is'
........'some'
.............'text'
.....................'with'
..........................'punctuation'
'[A-Z]+' (sequences of uppercase letters)
'This is some text -- with punctuation'
'T'
'[a-zA-Z]+' (sequencesof lower- or uppercase letters)
'This is some text -- with punctuation'
'This'
.....'is'
........'some'
.............'text'
.....................'with'
..........................'punctuation'
'[a-z][A-Z]+' (one uppercase followed by lowercase)
'This is some text -- with punctuation'
元字符点号(.)指示模式应当匹配该位置的单个字符
test_pattern('This is some text -- with punctuation',
[('a.','a followed by any one character'),
('b.','b follwed by any one character'),
('a.*b','a followed by anything ending in b'),
('a.*?b','a followed by anything, ending in b')],
)
____________________________输出_____________________________________
'a.' (a followed by any one character)
'This is some text -- with punctuation'
................................'at'
'b.' (b follwed by any one character)
'This is some text -- with punctuation'
'a.*b' (a followed by anything ending in b)
'This is some text -- with punctuation'
'a.*?b' (a followed by anything, ending in b)
'This is some text -- with punctuation'
转义码
转义码 | 含义 |
\d |
数字 |
\D |
非数字 |
\s | 空白符(制表符、空格、换行等) |
\S | 非空白符 |
\w |
字母数字 |
\W | 非字母数字 |
test_pattern('A prime #1 example!',
[(r'\d+','sequence of digits'),
(r'\D+','sequence of non-digits'),
(r'\s+','sequence of whitespqce'),
(r'\S+','sequence of non-whitespqce'),
(r'\w+','alphanumeric characters'),
(r'\W+','non-alphanumeric'],
)
___________________________输出_______________________________
'\d+' (sequence of digits)
'A prime #1 example!'
.........'1'
'\D+' (sequence of non-digits)
'A prime #1 example!'
'A prime #'
..........' example!'
'\s+' (sequence of whitespqce)
'A prime #1 example!'
.' '
.......' '
..........' '
'\S+' (sequence of non-whitespqce)
'A prime #1 example!'
'A'
..'prime'
........'#1'
...........'example!'
'\w+' (alphanumeric characters)
'A prime #1 example!'
'A'
..'prime'
.........'1'
...........'example'
'\W+' (non-alphanumeric)
'A prime #1 example!'
.' '
.......' #'
..........' '
..................'!'
要匹配正则表达式语法中包含的字符,需要转义搜索模式中的字符。
test_pattern(r'\d+ \D+ \s+',[(r'\\.\+','escape code')],)
________________________输出_____________________________
'\\.\+' (escape code)
'\d+ \D+ \s+'
'\d+'
.....'\D+'
..........'\s+'
锚定
可以使用锚定指令指定模式在输入文本中的相对位置。
正则表达式锚定码
锚定码 | 含义 |
^ | 字符串或行开头 |
$ | 字符串或行末尾 |
\A | 字符串开头 |
\Z | 字符串末尾 |
\b | 单词开头或末尾的空串 |
\B | 不在的单词开头或末尾的空串 |
test_pattern('This is some text -- with punctuation',
[(r'^\w+','word at start of string'),
(r'\A\w+','word at start of string'),
(r'\w+\S*$','word near end of string'),
(r'\w+\S*\Z','word near end of string'),
(r'\bt\w+','t at end of word'),
(r'\Bt\B','not start or end of word')],
)
_____________________________输出__________________________________
'^\w+' (word at start of string)
'This is some text -- with punctuation'
'This'
'\A\w+' (word at start of string)
'This is some text -- with punctuation'
'This'
'\w+\S*$' (word near end of string)
'This is some text -- with punctuation'
..........................'punctuation'
'\w+\S*\Z' (word near end of string)
'This is some text -- with punctuation'
..........................'punctuation'
'\bt\w+' (t at end of word)
'This is some text -- with punctuation'
.............'text'
'\Bt\B' (not start or end of word)
'This is some text -- with punctuation'
.......................'t'
..............................'t'
.................................'t'