MPjobs tool for PSSe runs in Parallel

asked 2020-09-25 13:18:00 -0600

jconto
2701 ●10 ●30 ●41

updated 2021-06-29 12:34:42 -0600

I have written a python code, named MPjobs, that allow running as many instances of PSSe as CPU’s in a pc, in other words, runs PSSe in parallel at the process level. It uses pool.apply_async and a dictionary to pass the arguments. This tool is suitable for repetitive studies where the changing variable is known, like during benchmarking models, sensitivity runs or dynamic fault simulations.

[Updated 20210629] You can download the MPjobs tool with a demo set compatible with PSSe v.33, v.34 and v.35 (and python 2.7, v.3.7, v.3.8) from [copy the link into your browser if it does not work by clicking on it]:

At JContogoogledrive, enter the folder "MPjobs PSSe in Parallel" and then select “MPjobsjconto_xxxxx.zip”. An icon on the top-center screen will perform the download.

As it is, MPjobs can be used to parallelize runs from ‘almost’ any application that can run from a DOS window with an input file or line arguments.

Follow the instruction in the read.me file and in the wiki doc to run the demos included.

edit retag flag offensive close merge delete

Comments

Any chance you can give us a live virtual demo of MPjobs and Channels some day?

Type1_bus ( 2020-09-26 07:38:12 -0600 )edit

Awesome...

mbong ( 2020-11-08 20:33:02 -0600 )edit

Very cool, thanks for sharing. I may borrow some these concepts and incorporate them into my own tools.

likethevegetable ( 2021-07-15 11:51:05 -0600 )edit

Very nice tool for bulk system simulation

Yunzhi Cheng ( 2021-07-31 11:51:36 -0600 )edit

Hi jconto, I notice that for large batches of contingencies the tool starts skipping contingencies or gets stuck (MPAA mode). Is there a way to avoid this? The runs get processed but don’t get started. I’ve included a delay of 20 seconds.

Type1_bus ( 2021-11-03 10:22:51 -0600 )edit

see more comments

answered 2024-07-06 16:11:33 -0600

powerengineer
1 ●1 ●2 ●2

updated 2024-07-11 16:02:59 -0600

Hi Jose, I am trying to use the MPjobs tool to run parallel simulations. I downloaded the latest version, followed the instructions to change the PSSE path, and tried to run 1D or 2D scenarios, but I'm getting this error.

I'm using the command mpjobs35 inis\cmld_3d

I get the error: Traceback (most recent call last): File "C:\Users\jsm20\Documents\code\Python\mpjobs.py", line 58, in <module> AttributeError: module 'JCtools' has no attribute 'pyver'

```````````````````````````````````````````

Update after trying the the latest version:

Now, I can see the compiled python file in MPjobs folders (mpjobs_p39x64.pyc), but I still can't run MPjobs. I am using PSSE 35.6 with python 3.9.12.

I tried both methods of using INI file to run simulation with mpjobs35 (it doesn't do anything) and mpjobs35 inis\mpjobs. Whe mtype in ini file is MPP, it gives an error When mtype in ini file is MPAA, it runs the code and loops through 8 scenarios, but it doesn't actually load the psspy to run the situation, so no logs or out files are generated.

running with mtype=MPAA

D:\SimulationCoding\CoSim\PSSE\parallelpsse\MPjobsParallellatest\MPjobsjconto_20240704>mpjobs35 inis\mpjobs inis\mpjobs.ini

```````````````````````````````````````````

                   MPjobs                  v.20230809
       python parallel processing engine

```````````````````````````````````````````

processing MPAA run 1, P1faultsSB1b152 inis\mpjobs.ini 0 processing MPAA run 2, P1faultsSB1b153 0 processing MPAA run 3, P1faultsSB2b154 0 processing MPAA run 4, P1faultsSB2b205 0 processing MPAA run 5, P1faultsSB3b201 0 processing MPAA run 6, P1faultsSB3b204 0 processing MPAA run 7, P1faultsSB3b205 0 processing MPAA run 8, P1faultsSB4b202 0

--- mpjobs [MPAA] finished in 8.11 seconds ---

```````````````````````````````````````````

Here running with mtype = MPP

D:\SimulationCoding\CoSim\PSSE\parallelpsse\MPjobsParallellatest\MPjobsjconto_20240704>mpjobs35 inis\mpjobs inis\mpjobs.ini

```````````````````````````````````````````

                   MPjobs                  v.20230809
       python parallel processing engine

```````````````````````````````````````````

Processing MPP group 0

Processing MPP group 1 inis\mpjobs.ini inis\mpjobs.ini 0 Process Process-1: Traceback (most recent call last): File "C:\Users\msarwar\AppData\Local\Programs\Python\Python39\lib\multiprocessing\process.py", line 315, in bootstrap self.run() File "C:\Users\msarwar\AppData\Local\Programs\Python\Python39\lib\multiprocessing\process.py", line 108, in run self.target(self._args, *self.kwargs) File "C:\Users\jsm20\Documents\code\Python\mpjobs.py", line 116, in runmpp File "<string>", line 30, in <module> File "<string>", line 1, in <module> ModuleNotFoundError: No module named 'psse35' Traceback (most recent call last): File "C:\Users\jsm20\Documents\code\Python\mpjobs.py", line 284, in <module> File "C:\Users\jsm20\Documents\code\Python\mpjobs.py", line 221, in main File "C:\Users\msarwar\AppData\Local\Programs\Python\Python39\lib\multiprocessing\queues.py", line 103, in get res = self.recvbytes() File "C:\Users\msarwar\AppData\Local\Programs\Python\Python39\lib\multiprocessing\connection.py ... (more)

edit flag offensive delete link

Comments

Thanks for trying MPjobs. I have updated the files and clean some of the scripts for python 3.9 (all dev was done in python 2.7!) Please download it again, tested and let me know your experience with it.

jconto ( 2024-07-11 09:05:27 -0600 )edit

Hi Jose, Thank you for updating the files. Now, I can see the compiled python file in MPjobs folders (mpjobs_p39x64.pyc), but I still can't run MPjobs. I am using PSSE 35.6 with python 3.9.12. I've updated my original comment as comments have limited length. Thanks..

powerengineer ( 2024-07-11 15:49:42 -0600 )edit

In error messages:"ModuleNotFoundError: No module named 'psse35' " Q0: full or student version? Q1: did you open a DOS window using the link provided (__dos3539)? Q2: show PSSe35.exe path Q3: Open a DOS window and enter "set", show value for "psspypath", "path" content, is psse path on it?

jconto ( 2024-07-12 15:48:52 -0600 )edit

add a comment

MPjobs tool for PSSe runs in Parallel

Comments

1 answer

Comments

Your Answer

Question Tools

Stats

Related questions