Python Tutorial – 31. Multiprocessing Pool (Map Reduce)

///Python Tutorial – 31. Multiprocessing Pool (Map Reduce)

Python Tutorial – 31. Multiprocessing Pool (Map Reduce)

FavoriteLoadingAdd to favorites

This tutorial goes over how multiprocessing pool can be used to divide the work among multiple cores of your computer. Also it covers simple explanation of map reduce concept.

Link for code:

Next Video:
Python unit testing – pytest introduction:

Website:
Facebook:
Twitter:
Patreon:

source

By |2019-12-15T00:34:37+00:00December 15th, 2019|Python Video Tutorials|27 Comments

27 Comments

  1. codebasics December 15, 2019 at 12:34 am - Reply
  2. Brian Hernandez December 15, 2019 at 12:34 am - Reply

    Hi.. How can I integrate Multiprocessing Script with my exiting Project?

  3. Prakash Babu December 15, 2019 at 12:34 am - Reply

    nice explanation. plz explain how to find lcs using pooling

  4. Omar alpjaly December 15, 2019 at 12:34 am - Reply

    so what is the difference between multiprocessing.Process and multiprocessing.Pool ?

  5. m.o.a.m December 15, 2019 at 12:34 am - Reply

    Wooow, great explanation man, thanks!

  6. Amin Tash December 15, 2019 at 12:34 am - Reply

    Thanks for your video. I do have a question about multiprocessing. Here I asked it on StackOverflow.
    https://stackoverflow.com/questions/57529308/solving-a-problem-utilizing-multiprocessing-and-value-in-python
    I appreciate any help.
    Solving the same problem using the new approach provided in your video, still, I get no benefits in term of speed.

  7. KARAB1NAS December 15, 2019 at 12:34 am - Reply

    What happens if you don’t use join and close??

  8. KARAB1NAS December 15, 2019 at 12:34 am - Reply

    Very good video!

  9. raju goud M December 15, 2019 at 12:34 am - Reply

    You are passing 10000 as n to pool but your are not using it in your function. It's just using range. Not an ideal comparison but concept wise it's clear.

  10. Haider Khattak December 15, 2019 at 12:34 am - Reply

    That's a pretty helpful example. is it possible to pass multiple arguments to the functions using pool.map? btw your ppt is an awesome and precise way of explaining the procedure. hats off.

  11. Moziah San Vicente December 15, 2019 at 12:34 am - Reply

    thank you so much! i have been looking for the close and join methods. None of the examples I've found so far use these, and this was leading to a huge pileup of stale processes on my cpu.

  12. Amin Tash December 15, 2019 at 12:34 am - Reply

    great job!

  13. Joseph Baron December 15, 2019 at 12:34 am - Reply

    This is a great tutorial. I really like how you split things up into "bitesize" videos so that it's easy to find advice on exactly what you want to learn

  14. Jiawei Yu December 15, 2019 at 12:34 am - Reply

    Very logical and clear explanations! Thank you.

  15. karthikeyan mg December 15, 2019 at 12:34 am - Reply

    Awesome man!!!
    I actually ended up using multiprocessing in one of my projects… Saved me a lot of time
    Keep it up! Good job

  16. Sumit Malik December 15, 2019 at 12:34 am - Reply

    Thanks for the videos, They are very good!!. for someone who is trying in jupyter notebook, for multiprocessing can save the piece of definition code as different module and then import it with module.py

  17. Amber DeJohn December 15, 2019 at 12:34 am - Reply

    Thanks for the video! I've looked at the documentation for Pool several times, but your video was the first time it made sense. You explain things very well!

  18. Artin Bogdanov December 15, 2019 at 12:34 am - Reply

    Good job!

  19. naveen chauhan December 15, 2019 at 12:34 am - Reply

    excellent way of teaching. thank you for this precise and very clear way of explaining.

  20. Benjamin Ho December 15, 2019 at 12:34 am - Reply

    The best explanation of MapReduce ever ! Simple and straightforward

  21. zero study December 15, 2019 at 12:34 am - Reply

    Music when you are pause, resume, revert, the video made me kind a headache

  22. Manohar Jadeja December 15, 2019 at 12:34 am - Reply

    Thank you for providing such excellent contents

  23. Stephan Bitterwolf December 15, 2019 at 12:34 am - Reply

    Great video series! Thank you so much!

  24. Hepzi Rani December 15, 2019 at 12:34 am - Reply

    Thank you for your clear explanation.it is easy to understand.

  25. Ilkin Huseynzade December 15, 2019 at 12:34 am - Reply

    Thank you for precise and simple explanation. What is the difference between thread and multiprecessing? Can we use the multiprocessing features you explained until here in multithreading?

  26. Abhishek Sahu December 15, 2019 at 12:34 am - Reply

    Thank you. Subscribed from the get-go

  27. 余宗翰 December 15, 2019 at 12:34 am - Reply

    this series is awesome!

Leave A Comment

*