Repository navigation
folium.features.Circle not pickable #796
Description
hi:
i try to parallelise a code , but apparently Circle is not pickable
do you have any solution ?
in any case thank you for all your work
from concurrent import futures
import multiprocessing
def emptyListFuturs(listOfFuturs,map_osm):
for fut in futures.as_completed(listOfFuturs):
putToMapOSM(fut.result(),map_osm)
def map_all_sensor():
dic = modeDict()
nbThreads = multiprocessing.cpu_count()
listOfFuturs=[]
map_osm = make_map_paris()
arrayOfItems=[]
cmp=0
cmpJ=0
executor = futures.ProcessPoolExecutor(max_workers=nbThreads)
for id,item in tqdm(dic.items()):
if(not np.isnan(item).any()):
if(len(item)==2):
#lat=item[0]
#lon=item[1]
arrayOfItems.append(item)
cmp+=1
#folium.Circle(radius=10,location=item,popup='The Waterfront',color='crimson',fill=False).add_to(map_osm)
if(cmp==10):
listOfFuturs.append(executor.submit(createOSMObjectArray,arrayOfItems))
arrayOfItems=[]
cmpJ+=1
cmp=0
if(cmpJ>10):
emptyListFuturs(listOfFuturs,map_osm)
listOfFuturs=[]
emptyListFuturs(listOfFuturs,map_osm)
executor.shutdown()
if(cmp>1):
putToMapOSM(createOSMObjectArray(arrayOfItems),map_osm)
map_osm.save('sensors_map.html')
def putToMapOSM(arrayOfItems,map_osm):
for i in arrayOfItems:
i.add_to(map_osm)Reacted by Haddad Ahmed
Activity
Conengmo commentedon Dec 10, 2017
I didn't try you example, it's not a minimal working example. But since you mentioned that
Circleis not pickable, I tried that. And indeed it seems you cannot pickle Folium objects:I guess you can produce your data using concurrency, but not create Folium objects concurrently. I don't know what to do about this.
Conengmo commentedon Apr 21, 2018
Here is another resource on this topic:
https://stackoverflow.com/questions/8804830/python-multiprocessing-pickling-error
I think for now this is not something that needs to be fixed, if it's reasonably possible at all.
HADDADENICAR commentedon Jun 1, 2018
Hey @Conengmo i have the same problem but with spark what should i do ?
Conengmo commentedon Oct 12, 2018
I'm closing this old issue since we are not going to fix this. If new information comes up feel free to add it, we can reopen if needed.