How are we doing? Please help us improve Stack Overflow. Take our short survey

Questions tagged [python-multiprocessing]

multiprocessing is a package that supports spawning processes using an API similar to the threading module in python programming language.

Filter by
Sorted by
Tagged with
0
votes
0answers
18 views

Python multiprocessing queue fails with subprocesses

I'm trying to add spawned subprocesses to a queue so that only one can execute at a time. I don't want to wait for the process to execute with each iteration of the for loop because there is some code ...
0
votes
0answers
4 views

Multiprocessing Pipe out_pipe blocked (python2)

I have a problem using Pipe in multiprocessing. Under certain conditions the message is not added to out_pipe (out_pipe.send is not executed). The consequence is that in_pipe.recv() does not get ...
0
votes
0answers
9 views

Python Multi Processing - Class Instance updation not performed correctly

Currently I have requirement to use multi processing in Python. My requirement is to create a list of object in one process and update each object in other process. I referred various solutions in ...
0
votes
1answer
20 views

Strange Behavior of Multiprocess Manager Ignoring Rest of Code Block

I am experiencing strange behaviors regarding Manager, where the code from the same code block after it's instantiation gets ignored. I am running this on Windows 10. When I run only the following ...
0
votes
2answers
30 views

Python multiprocess with class instance

I have a question that is not really related to a problem I have but rather to why it is not a problem. Perhaps is a bit dumb, but I am not super familiar with classes and I'm trying to learn. Let's ...
0
votes
0answers
12 views

Python Processing continues even do i have Process.join

When i run it, it skips the for loop and continues but then after that it does the train() as below Finish in 0.0 seconds Coefficient: [ 0.17051587 0.9661849 -0.23257482 -0.29750047 0.03799901] ...
2
votes
1answer
27 views

Python - Combining multiprocessing with asyncio works only sometimes

I would like to combine asyncio and multiprocessing as I have a task where a part is io-bound and another is cpu-bound. I first tried to use loop.run_in_executor(), but I couldn't get it to work ...
0
votes
0answers
16 views

Multiproccessing in a while loop

I want to run a producer consumer Multiprocessing schema in a while loop for as long as there are jobs in the task list here is the code from multiprocessing import Process, Queue, Lock, Manager if ...
0
votes
0answers
20 views

Multiple processes stuck at big loop in Python

I am using Django with Nginx for my web application. I have spawned two processes with below setting for uWsgi and assigned one core to each process. --master --processes=2 --threads=1 Request lands ...
0
votes
1answer
34 views

python pickle string in multiprocessing

I'm having a hard time using multiprocessing in python, though I have not used much multiprocessing in any platform and do not have clear idea of how queues work in multi-process communication. (If ...
-3
votes
0answers
20 views

Improve Speed of multiprocessing script

my script uses a Python Module named finanzen_fundamentals to get stock data from a Website. On my Websiteload a Python webserver is called which should return a json with stock + actual price The ...
1
vote
0answers
17 views

How to implement iterable consuming multiprocess pool in Python 3

I need to use a worker pool of processes in order to make parallel network complex stuff. So, every worker must be initialized with its own session object (that will be instanciated once and for all ...
0
votes
1answer
32 views

Multiprocessing for appending text extracted with a loop to a list in Python

As a Python (and programming) novice, I am trying to extract the text of thousands of PDFs into a file (or list, if better). The data is going to be used for content analysis at a later stage. I ...
2
votes
1answer
61 views

How to share (or exclude from sharing) global variables over multiprocess?

In Linux, I understand whenever you fork a child process, the child process gets a copy of the parent process address space. I don't understand why this is always desirable. The parent process may ...
0
votes
0answers
17 views

Reading keys from an .npz file with multiple workers in pytorch dataloader?

I have an .npz file where I have stored a dictionary. The dictionary has some keys and the values are numpy arrays. I want to read the dictionary in my getitem() method of the dataloader. When I set ...

15 30 50 per page
1
2 3 4 5
229