如何去掉字符串中不需要的字符?

需求:
1、过滤用户输入中前后多余的空白字符
' nick2008@email.com '
2、过滤某windows下编辑文本中的'\r':
'hello world\r\n'
3、去掉文本中的unicode组合符号(音调):
tiān xià dì yī
思路:
1、字符串strip(),lstrip(),rstrip()方法去掉字符串两端字符
2、删除单个固定位置字符,可以使用切片+拼接的方式
3、字符串的replace()方法或者正则表达式re.sub()删除任意位置字符
4、字符串的translat()方法,可以同时删除多种不同字符

代码:

s1 = '   nick2008@email.com   '
s2 = '---abc+++'
# strip()去除字符串首尾两端的字符,默认为空白字符。
print(s1.strip())
print(s2.strip('-+'))

s3 = 'abc:123'
#删除字符串中的:
print(s3[:3]+s3[4:])

s4 = '\tabc\t123\txyz'
#删除字符串的\t
print(s4.replace('\t',''))

s5 = '\tabc\t123\txyz\ropq\r'

# 去除字符串中的\t\r
import re

ret = re.sub('[\t\r]','',s5)

print(ret)

s6 = 'abc1230323xyz'

#将字符串的a-->x,b-->y,c-->z,x-->a,y-->b,z-->a
# 生成映射表
table = str.maketrans('abcxyz','xyzabc')

# 使用translate的方法,完成这个映射的功能
ret2 = s6.translate(table)
print(ret2)

s7 = 'tiān xià dì yī'
# 去除字符串的音调
import sys
import unicodedata
remp = {
# ord返回ascii值
ord('\t'): '',
ord('\f'): '',
ord('\r'): None
}
# 去除\t,\f,\r
s7.translate(remp)
'''
通过使用dict.fromkeys()方法构造一个字典,每个unicode和音符作为键,对应的值全部为None,
然后使用unicodedata.normalize()将原始输入标准化为分解形式字符
sys.maxunicode:给出最大Unicode代码的值的整数,即1114111(十六进制的0x10FFFF).
unocodedata.combining:将分配给字符chr的规范组合类作为整数返回,如果未定义组合类,则返回0.
'''
cmb_chrs = dict.fromkeys(c for c in range(sys.maxunicode) if unicodedata.combining(chr(c)))
b = unicodedata.normalize('NFD',s7)
#调用chraslate函数删除所有重音符
print(b.translate(cmb_chrs))

#方法2:
print(unicodedata.normalize('NFKD',s7).encode('ascii','ignore').decode())

===============================================================================

>>> s = '   richardo@qq.com   '

>>> s.strip()
'richardo@qq.com'

>>> s.lstrip()
'richardo@qq.com   '

>>> s.rstrip()
'   richardo@qq.com'

>>> s = ' \t   richardo@qq.com \n  '

>>> s.strip()
'richardo@qq.com'

>>> s = '====richardo@qq.com======'

>>> s.strip('=')
'richardo@qq.com'

>>> s = '==+-==richardo@qq.com===+-==='

>>> s.strip('=+-')
'richardo@qq.com'

>>> s2 = 'abc:1234'

>>> s2[:3] + s2[4:]
'abc1234'

>>> s3 = '   xyz   acb   fn '

>>> s3.strip()
'xyz   acb   fn'

>>> s3.replace(' ','')
'xyzacbfn'

>>> s3 = ' \t abc \t xyx \n '

>>> s3.replace(' ','')
'\tabc\txyx\n'

>>> import re

>>> re.sub('[ \t\n]+', '', s3)
'abcxyx'

>>> re.sub('\s+','',s3)  # 一个或者多个的空白字符
'abcxyx'

>>> s = 'abc1234xyz'

>>> s.translate?
Docstring:
S.translate(table) -> str

Return a copy of the string S in which each character has been mapped
through the given translation table. The table must implement
lookup/indexing via __getitem__, for instance a dictionary or list,
mapping Unicode ordinals to Unicode ordinals, strings, or None. If
this operation raises LookupError, the character is left untouched.
Characters mapped to None are deleted.
Type:      builtin_function_or_method

>>> s.translate({'a':'X'})
'abc1234xyz'

>>> ord('a')
97

>>> s.translate({ord('a'):'X'})
'Xbc1234xyz'

>>> s.translate({ord('a'):'X',ord('b'):'Y'})
'XYc1234xyz'

>>> s.maketrans('abcxyz','XYZABC')
{97: 88, 98: 89, 99: 90, 120: 65, 121: 66, 122: 67}

>>>  s.translate(s.maketrans('abcxyz','XYZABC'))
'XYZ1234ABC'

>>> s.translate({ord('a'):None})
'bc1234xyz'

>>> s4 = 'tiān xià dì yī'

>>> c = 'à'

>>> len(c)
1

>>> c[0]
'à'

>>> s5 = 'nǐ hǎo'

>>> d = 'ǎ'

>>> len(d)
1

>>> import unicodedata

>>> unicodedata.combining(d[1])
---------------------------------------------------------------------------
IndexError                                Traceback (most recent call last)
<ipython-input-103-a8ef43ca7ee4> in <module>
----> 1 unicodedata.combining(d[1])

IndexError: string index out of range

>>> unicodedata.combining(d[0])
0

>>> mystr = 'Lǐ Zhōu Wú'

>>> unicodedata.normalize('NFKD', mystr).encode('ascii','ignore')
b'Li Zhou Wu'

>>> str(unicodedata.normalize('NFKD', mystr).encode('ascii','ignore'))
"b'Li Zhou Wu'"

>>> type(unicodedata.normalize('NFKD', mystr).encode('ascii','ignore'))
bytes

>>> unicodedata.normalize('NFKD', mystr).encode('ascii','ignore').decode()
'Li Zhou Wu'

>>> 

posted @ 2020-07-10 23:34  Richardo-M-Lu  阅读(2039)  评论(0编辑  收藏  举报