摘要: from pyspark.sql.functions import get_json_object, col,from_unixtime, instr, length, regexp_replace, explode, from_json from pyspark.sql.types import 阅读全文
posted @ 2024-11-07 15:57 Young_Mo 阅读(1) 评论(0) 推荐(0) 编辑
摘要: http://pypi.douban.com/simple/ 豆瓣http://mirrors.aliyun.com/pypi/simple/ 阿里http://pypi.hustunique.com/simple/ 华中理工大学http://pypi.sdutlinux.org/simple/ 山 阅读全文
posted @ 2024-10-30 14:18 Young_Mo 阅读(3) 评论(0) 推荐(0) 编辑
摘要: select table_name, column_name, data_type, udt_name, table_catalog, table_schema, table_name, column_name, ordinal_position, column_defaultfrom inform 阅读全文
posted @ 2023-11-14 17:35 Young_Mo 阅读(204) 评论(0) 推荐(0) 编辑
摘要: import scala.collection.immutable object chapter07_08 { def main(args: Array[String]): Unit = { println(multiTable()) } def makeRowSeq(row: Int) = for 阅读全文
posted @ 2023-06-13 10:22 Young_Mo 阅读(36) 评论(0) 推荐(0) 编辑
摘要: # 定义一个专门创建事件循环loop的函数,在另一个线程中启动它 def start_loop(loop): asyncio.set_event_loop(loop) loop.run_forever() @app.get("/addr") def index(adcode: str = None, 阅读全文
posted @ 2023-06-07 16:02 Young_Mo 阅读(108) 评论(0) 推荐(0) 编辑
摘要: 数据处理把 list嵌套字段转成 pyspark dataframe # coding=utf-8 from pyspark.sql import SparkSession from pyspark.sql.types import * import pandas as pd from pyspar 阅读全文
posted @ 2023-04-25 10:11 Young_Mo 阅读(180) 评论(0) 推荐(0) 编辑
摘要: select * from addr_tmp at2 where addr ~ '[\uFF00-\uFFFF]' 匹配所有全角字符 匹配全角数字 '[\uFF10-\uFF19]' 阅读全文
posted @ 2023-02-01 15:43 Young_Mo 阅读(24) 评论(0) 推荐(0) 编辑
摘要: package main import ( "fmt" "io/ioutil" ) func main() { dirName := "D:\\tmp\\20220314" //fmt.Println(dirName) res := FileList(dirName, 0) for _, file 阅读全文
posted @ 2022-03-16 14:50 Young_Mo 阅读(343) 评论(0) 推荐(0) 编辑
摘要: package main import ( "encoding/csv" "fmt" "os" "unsafe" ) func readCsv(fPath string) (ret []map[string]string) { file, err := os.Open(fPath) if err ! 阅读全文
posted @ 2022-03-16 14:49 Young_Mo 阅读(34) 评论(0) 推荐(0) 编辑
摘要: package main import ( "encoding/csv" "encoding/json" "fmt" "io" "os" "strconv" "strings" "time" ) func readCsvYield(fPath string, seq rune, printNum i 阅读全文
posted @ 2022-03-09 15:14 Young_Mo 阅读(330) 评论(0) 推荐(0) 编辑