python split dict into chunks

Solutions on MaxInterview for python split dict into chunks by the best coders in the world

Search
showing results for - "python split dict into chunks"
Emanuele
29 Apr 2018
1# Since the dictionary is so big, it would be better to keep
2# all the items involved to be just iterators and generators, like this
3
4from itertools import islice
5
6def chunks(data, SIZE=10000):
7    it = iter(data)
8    for i in range(0, len(data), SIZE):
9        yield {k:data[k] for k in islice(it, SIZE)}
10        
11# Sample run:
12for item in chunks({i:i for i in range(10)}, 3):
13    print item
14    
15# Output
16# {0: 0, 1: 1, 2: 2}
17# {3: 3, 4: 4, 5: 5}
18# {8: 8, 6: 6, 7: 7}
19# {9: 9}
source
similar questions
numpy split to chunks of equal sizehow do you split a list into evenly sized chunks 3fhow to get values of nested dictionary in pythonpandas split dataframe into chunks with a conditionnumpy split array into chunks of equal sizesplit long list into chunks of 100how to split a string into a dictionary in pythonpython sorted dictionary multiple keyshow to convert multi list into dict in pythonexplode dictionary pandasdivide array into equal parts 2fslices pythonhow to divide two dictionaries pythonpython counter nested dictionarypython convert strings to chunkshow to break a list unequal size chunks in pythonhow to load multiple list of dictionary values which is stored in python file and load into another python file in python over loophow to devided array into parts pythonprint nested dictionary values in pythonsplit into list into even chunkssplit array into chunks python
queries leading to this page
split a big dictionary into smaller dictionariespython split dict into chunkspython break dictionary into chunkshow to split a dictionary into multiple dictionaries pythonhow to cut a dict into many smaller dicts pythonsplit dictionary in 26 filespython split dictionary to n chunkspython dictionary split to dictionary size 1python chunk dictionarypython split list to chunksjavascript split dictionary into dictionariessplit dictionary into chunks pythonpython dictionary into chunkssplit big dict into smaller dictssplit dict into chunks pythonpython split list of dictionary into chunkssplit dictionary into multiple dictionaries pythonhow do you split a dictionnary into evenly sized chunks 3fpython split list into chunkssplit string in chunks pythonpython split dictionary into chunkspython divide dictionary into chunkspython split dict into chunks