python怎么读取大概1400MB的大json文件

import codecs
content=''
with codecs.open('./xxx.json', 'r') as content_file:
for line in content_file.readlines():
content=content+line
records = json.loads(json.dumps(content))
jupyter 提示The kernel appears to have died. It will restart automatically.

读取的时候把GC关掉。采纳啊。

估计你机器内存不够了,用生成器,一行行读取

 for line in open(path):
       yield line.strip()

这才是 Pythonci 最完美的方式,既高效又快速:

 with open('filename', 'r', encoding = 'utf-8') as f:
    for line in f:
        do_something(line)

可以试试ijson
https://github.com/ictar/python-doc/blob/master/Science%20and%20Data%20Analysis/%E5%A6%82%E4%BD%95%E4%BD%BF%E7%94%A8Python%E5%92%8CPandas%E5%A4%84%E7%90%86%E5%A4%A7%E9%87%8F%E7%9A%84JSON%E6%95%B0%E6%8D%AE%E9%9B%86.md