Python Tutorial – 31. Multiprocessing Pool (Map Reduce)

///Python Tutorial – 31. Multiprocessing Pool (Map Reduce)

Python Tutorial – 31. Multiprocessing Pool (Map Reduce)

FavoriteLoadingAdd to favorites

This tutorial goes over how multiprocessing pool can be used to divide the work among multiple cores of your computer. Also it covers simple explanation of map reduce concept.
Link for code: https://github.com/codebasics/py/blob/master/Multiprocessing/multiprocessing_pool.py
Website: http://codebasicshub.com/
Facebook: https://www.facebook.com/codebasicshub
Twitter: https://twitter.com/codebasicshub
Google +: https://plus.google.com/106698781833798756600 Patreon: https://www.patreon.com/codebasics

By |2017-05-01T12:20:42+00:00April 26th, 2017|Programming Video Tutorials, Python Video Tutorials|13 Comments

13 Comments

  1. Norman Stansfield April 26, 2017 at 9:26 pm - Reply

    Good Work.

  2. chonlatee jumratsee April 26, 2017 at 9:27 pm - Reply

    good video thank you.

  3. Arvind Nagar April 26, 2017 at 9:29 pm - Reply

    hello… i have seen ur all videos… would you please help me out that… how would i add processes dynamically to pool.. i want to use my all resources with different processes… so how can i pass one by one process to pool to make my work faster with my system..

  4. artin antlsm April 26, 2017 at 9:33 pm - Reply

    Thanks so much

  5. Tomek Diederen April 26, 2017 at 9:36 pm - Reply

    Thanks so much for your tutorials! Great resource, keep up the good stuff!

  6. David Fazio April 26, 2017 at 9:37 pm - Reply

    Your explanation of multi processing, threading, and the differences between are excellent. Thank you for using general examples that are relatable as an introduction. This is exactly what I needed!

  7. Mahesh Sanapala April 26, 2017 at 10:00 pm - Reply

    Hey , your videos on multiprocessing have been super helpful. Appreciate if you can demonstrate the same concept using Object oriented style. Or any reference link?

  8. Osama Nsr April 26, 2017 at 10:08 pm - Reply

    didn’t get it what is the difference between this "Pool" and the earlier MultiProcessing ?!

  9. Muhamad Danish April 26, 2017 at 10:17 pm - Reply

    I want to know that the above explanation you gave about the pool and map reduce, covers the concept of load balancing among multiple processors? waiting for you reply please reply as soon as possible thanks.

  10. Linux Linux April 26, 2017 at 10:19 pm - Reply

    excellent tutorial sir……..please let us know how to be an expert in multi-threading using python..

  11. Alankar Dutta April 26, 2017 at 10:20 pm - Reply

    In map documentation I have seen an optional keyworded argument called chuncksize that can be given an integer value. I have seen that certain values speeds up my code and certain others decrease that. Can you please explain what is it for? Sorry I cannot make out properly from what the documentation says.

  12. Adiyat Mubarak April 26, 2017 at 10:22 pm - Reply

    thank you for the easy to understand tutorial. as you mentioned in the last chapter that we can define how many process. so how many processes if we just use the default?

  13. Jignesh Darji April 26, 2017 at 10:23 pm - Reply

    I like your videos, Appreciate your effort – I have one question, what is good source of learning for python on networking and/or SDN. Should be teach by example like you.

Leave A Comment

*