PHP Multiple Curl Requests

Question

I'm currently using Curl for PHP a lot. It takes a lot of time to get results of about 100 pages each time. For every request i'm using code like this

$ch = curl_init();

// get source

curl_close($ch);

What are my options to speed things up?

How should I use the multi_init() etc?

Answer of this thread is over here Multiple API requests

Delickate
– Delickate

2017-11-02 05:24:21 +00:00
Commented Nov 2, 2017 at 5:24 — Delickate
– Delickate, Commented Nov 2, 2017 at 5:24

Emil Vikström · Accepted Answer · 2010-10-10 11:46:28Z

48

Reuse the same cURL handler ($ch) without running curl_close. This will speed it up just a little bit.
Use curl_multi_init to run the processes in parallel. This can have a tremendous effect.

answered Oct 10, 2010 at 11:46

Emil Vikström

92.3k17 gold badges144 silver badges178 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Simon Over a year ago

I now use a curl_multi_init for about 10 requests at a time. Takes about 5 for 10 requests =D

urs_baer · Accepted Answer · 2010-11-21 18:03:18Z

8

take curl_multi - it is far better. Save the handshakes - they are not needed every time!

answered Nov 21, 2010 at 18:03

urs_baer

811 bronze badge

Comments

Community · Accepted Answer · 2017-05-23 10:31:25Z

1

when i use code given in "http://php.net/curl_multi_init", response of 2 requests are conflicting. But the code written in below link, returns each response separately (in array format) https://stackoverflow.com/a/21362749/3177302

edited May 23, 2017 at 10:31

CommunityBot

11 silver badge

answered Jan 23, 2015 at 9:25

abdulwadood

6067 silver badges15 bronze badges

Comments

Sastrija · Accepted Answer · 2011-10-06 10:25:00Z

0

or take pcntl_fork, fork some new threads to execute curl_exec. But it's not as good as curl_multi.

edited Oct 6, 2011 at 10:25

Sastrija

3,3826 gold badges52 silver badges67 bronze badges

answered Oct 6, 2011 at 3:28

cuttinger

1092 bronze badges

Collectives™ on Stack Overflow

PHP Multiple Curl Requests

4 Answers 4

1 Comment

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

1 Comment

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related