Perl中并行处理的最佳模块是什么?我从来没有在Perl中做过并行处理。什么是在Perl中进行并行处理的最佳模块?
什么是用于数据库访问和邮件发送的并行处理的好Perl模块?
我看了模块Parallel::ForkManager。任何想法赞赏。
Perl中并行处理的最佳模块是什么?我从来没有在Perl中做过并行处理。什么是在Perl中进行并行处理的最佳模块?
什么是用于数据库访问和邮件发送的并行处理的好Perl模块?
我看了模块Parallel::ForkManager。任何想法赞赏。
Parallel::ForkManager,正如POD所说,可以限制分叉进程的数量。然后你可以使用这些孩子做任何工作。我记得使用模块来下载。
你也可以看看线程,Coro,Parallel::Iterator。
那么,这一切都取决于具体情况。根据什么你到底需要实现,就可能是更好地与下列之一:
对于某些任务,也有专门的模块 - 为例如LWP::Parallel::UserAgent,这基本上意味着 - 您必须向我们提供更多关于您想要获得最佳答案的详细信息。
Perl的多核心引擎(MCE)已发布在CPAN上。
http://code.google.com/p/many-core-engine-perl/
https://metacpan.org/module/MCE
MCE自带显示在并行小猫咪的东西(尝试用-n),以greping的模式和字数统计汇总真实世界的使用情形各种例子。
barrier_sync.pl
A barrier sync demonstration.
cat.pl Concatenation script, similar to the cat binary.
egrep.pl Egrep script, similar to the egrep binary.
wc.pl Word count script, similar to the wc binary.
findnull.pl
A parallel driven script to report lines containing
null fields. It is many times faster than the binary
egrep command. Try against a large file containing
very long lines.
flow_model.pl
Demonstrates MCE::Flow, MCE::Queue, and MCE->gather.
foreach.pl, forseq.pl, forchunk.pl
These take the same sqrt example from Parallel::Loops
and measures the overhead of the engine. The number
indicates the size of @input which can be submitted
and results displayed in 1 second.
Parallel::Loops: 600 Forking each @input is expensive
MCE foreach....: 34,000 Sends result after each @input
MCE forseq.....: 70,000 Loops through sequence of numbers
MCE forchunk...: 480,000 Chunking reduces overhead
interval.pl
Demonstration of the interval option appearing in MCE 1.5.
matmult/matmult_base.pl, matmult_mce.pl, strassen_mce.pl
Various matrix multiplication demonstrations benchmarking
PDL, PDL + MCE, as well as parallelizing Strassen
divide-and-conquer algorithm. Also included are 2 plain
Perl examples.
scaling_pings.pl
Perform ping test and report back failing IPs to
standard output.
seq_demo.pl
A demonstration of the new sequence option appearing
in MCE 1.3. Run with seq_demo.pl | sort
tbray/wf_mce1.pl, wf_mce2.pl, wf_mce3.pl
An implementation of wide finder utilizing MCE.
As fast as MMAP IO when file resides in OS FS cache.
2x ~ 3x faster when reading directly from disk.
是否要并行化CPU绑定或IO绑定代码? – jrockway 2009-10-21 09:59:11