Почему я получаю пустой массив после очистки веб-страниц с помощью CURL и фильтрации с помощью регулярных выражений?

Question

Я новичок в синтаксисе curl и regex. Я попытался получить название изображений на этой странице Amazon, но мне не удалось. Я не знаю, почему я всегда получаю пустой массив.

Вот код:

$curl = curl_init(); //$curl is going to be data type curl resource

$search_string = "aser";
$url = "https://www.amazon.com/s/field-keywords=$search_string";

curl_setopt($curl, CURLOPT_URL, $url);
curl_setopt($curl, CURLOPT_SSL_VERIFYPEER, false);
curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);

$result = curl_exec($curl);

preg_match_all('!https://images-na.ssl-images-amazon.com/images/I/[^\s]*?._AC_US200_.jpg!', $result, $matches);

$images = array_values(array_unique($matches[0]));
print_r($images);

curl_close($curl);

Это то, что я получаю, когда print_r($images):

Array ( )

Answer 1

Измените свое регулярное выражение на:

preg_match_all('/"https:\/\/images-na\.ssl-images-amazon\.com\/images\/I\/.*_AC_US200_.jpg"/',$result,$matches);

Answer 2

Я пекла в некоторых условиях, чтобы помочь обработать неудачные результаты.

Ваш шаблон регулярных выражений можно немного настроить, убрав точки \. и заменив класс отрицательных символов [^\s] на \S и удалив модификатор lazy на квантификаторе (от *? до *). Эти корректировки улучшат краткость, точность и производительность шаблона.

Запись preg_match_all() внутри оператора условия важна, поскольку исключает возможность создания Уведомления при попытке доступа / обработки $matches.

Я также меняю array_values(array_unique()) на array_keys(array_flip()), потому что array_unique() не славится своей скоростью.

Код:

<code>$search_string = "aser";
$url = "https://www.amazon.com/s/field-keywords=$search_string";

if (!$ch = curl_init()) {
    echo "Failed to generate curl handle";
} else {
    curl_setopt($ch, CURLOPT_URL, $url);
    curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, false);
    curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
    curl_setopt($ch, CURLOPT_COOKIE, true);
    if (!$result = curl_exec($ch)) {
        echo "CURL error: " , curl_error($ch);
    } else {
        // var_export($result);
        if (!$count = preg_match_all('~https://images-na\.ssl-images-amazon\.com/images/I/\S*\._AC_US200_\.jpg~', $result, $matches)) {
            echo "No matches from CURL result";
        } else {
            $unique_matches = array_keys(array_flip($matches[0]));
            echo "Number of matches (including duplicates): " , $count;
            echo "<br>Number of unique matches: " , sizeof($unique_matches);
            echo "<pre>";
                var_export($unique_matches);
            echo "

"; } } curl_close ($ ч); }

Выход (сегодня):

Number of matches (including duplicates): 105
Number of unique matches: 51
array (
  0 => 'https://images-na.ssl-images-amazon.com/images/I/312aWjJbA6L._AC_US200_.jpg',
  1 => 'https://images-na.ssl-images-amazon.com/images/I/41vvgZSuo+L._AC_US200_.jpg',
  2 => 'https://images-na.ssl-images-amazon.com/images/I/51akl1-JppL._AC_US200_.jpg',
  3 => 'https://images-na.ssl-images-amazon.com/images/I/41hY4JMK9DL._AC_US200_.jpg',
  4 => 'https://images-na.ssl-images-amazon.com/images/I/51grWJDfRqL._AC_US200_.jpg',
  5 => 'https://images-na.ssl-images-amazon.com/images/I/618HsMLxiRL._AC_US200_.jpg',
  6 => 'https://images-na.ssl-images-amazon.com/images/I/51Xk7SB4XcL._AC_US200_.jpg',
  7 => 'https://images-na.ssl-images-amazon.com/images/I/41XD8vzETkL._AC_US200_.jpg',
  8 => 'https://images-na.ssl-images-amazon.com/images/I/515Llv02R-L._AC_US200_.jpg',
  9 => 'https://images-na.ssl-images-amazon.com/images/I/51PShds9wgL._AC_US200_.jpg',
  10 => 'https://images-na.ssl-images-amazon.com/images/I/21A8BB4Rr8L._AC_US200_.jpg',
  11 => 'https://images-na.ssl-images-amazon.com/images/I/41FgGD-l6IL._AC_US200_.jpg',
  12 => 'https://images-na.ssl-images-amazon.com/images/I/51cWC51Cz2L._AC_US200_.jpg',
  13 => 'https://images-na.ssl-images-amazon.com/images/I/41GSAH9C+FL._AC_US200_.jpg',
  14 => 'https://images-na.ssl-images-amazon.com/images/I/41FzWLl4rgL._AC_US200_.jpg',
  15 => 'https://images-na.ssl-images-amazon.com/images/I/41ej5-EYX4L._AC_US200_.jpg',
  16 => 'https://images-na.ssl-images-amazon.com/images/I/51cxADccMiL._AC_US200_.jpg',
  17 => 'https://images-na.ssl-images-amazon.com/images/I/51G7mMSXgCL._AC_US200_.jpg',
  18 => 'https://images-na.ssl-images-amazon.com/images/I/51baxIno6CL._AC_US200_.jpg',
  19 => 'https://images-na.ssl-images-amazon.com/images/I/31mPoO28QnL._AC_US200_.jpg',
  20 => 'https://images-na.ssl-images-amazon.com/images/I/41pZ4eg6PiL._AC_US200_.jpg',
  21 => 'https://images-na.ssl-images-amazon.com/images/I/51C8rmac8GL._AC_US200_.jpg',
  22 => 'https://images-na.ssl-images-amazon.com/images/I/61dDvHqYFaL._AC_US200_.jpg',
  23 => 'https://images-na.ssl-images-amazon.com/images/I/41sMpLjlXCL._AC_US200_.jpg',
  24 => 'https://images-na.ssl-images-amazon.com/images/I/51iWS9LJFBL._AC_US200_.jpg',
  25 => 'https://images-na.ssl-images-amazon.com/images/I/115DauVSG3L._AC_US200_.jpg',
  26 => 'https://images-na.ssl-images-amazon.com/images/I/21dMy9USZIL._AC_US200_.jpg',
  27 => 'https://images-na.ssl-images-amazon.com/images/I/51Rm4-vT2dL._AC_US200_.jpg',
  28 => 'https://images-na.ssl-images-amazon.com/images/I/51YWdlSwfEL._AC_US200_.jpg',
  29 => 'https://images-na.ssl-images-amazon.com/images/I/51EH7k5FpxL._AC_US200_.jpg',
  30 => 'https://images-na.ssl-images-amazon.com/images/I/41igaez7uIL._AC_US200_.jpg',
  31 => 'https://images-na.ssl-images-amazon.com/images/I/418QEnTiW7L._AC_US200_.jpg',
  32 => 'https://images-na.ssl-images-amazon.com/images/I/51KHWYGSWKL._AC_US200_.jpg',
  33 => 'https://images-na.ssl-images-amazon.com/images/I/41YSiBizmDL._AC_US200_.jpg',
  34 => 'https://images-na.ssl-images-amazon.com/images/I/41NI6VgawgL._AC_US200_.jpg',
  35 => 'https://images-na.ssl-images-amazon.com/images/I/41g86u-lDnL._AC_US200_.jpg',
  36 => 'https://images-na.ssl-images-amazon.com/images/I/51Dw7RNztAL._AC_US200_.jpg',
  37 => 'https://images-na.ssl-images-amazon.com/images/I/31yOzULiuJL._AC_US200_.jpg',
  38 => 'https://images-na.ssl-images-amazon.com/images/I/41cwE0JAc7L._AC_US200_.jpg',
  39 => 'https://images-na.ssl-images-amazon.com/images/I/51FczAZusTL._AC_US200_.jpg',
  40 => 'https://images-na.ssl-images-amazon.com/images/I/5123tSQVLhL._AC_US200_.jpg',
  41 => 'https://images-na.ssl-images-amazon.com/images/I/21qE9DbUPOL._AC_US200_.jpg',
  42 => 'https://images-na.ssl-images-amazon.com/images/I/51bmfezfl6L._AC_US200_.jpg',
  43 => 'https://images-na.ssl-images-amazon.com/images/I/41WlXMEj--L._AC_US200_.jpg',
  44 => 'https://images-na.ssl-images-amazon.com/images/I/61yxq875hwL._AC_US200_.jpg',
  45 => 'https://images-na.ssl-images-amazon.com/images/I/216na69C7UL._AC_US200_.jpg',
  46 => 'https://images-na.ssl-images-amazon.com/images/I/316I0rZ2DVL._AC_US200_.jpg',
  47 => 'https://images-na.ssl-images-amazon.com/images/I/31+YG+B0nJL._AC_US200_.jpg',
  48 => 'https://images-na.ssl-images-amazon.com/images/I/41NANHOzveL._AC_US200_.jpg',
  49 => 'https://images-na.ssl-images-amazon.com/images/I/41FPdhl6vlL._AC_US200_.jpg',
  50 => 'https://images-na.ssl-images-amazon.com/images/I/21w5Rqsuc-L._AC_US200_.jpg',
)

Answer 3

хорошо, я обнаружил, что результат $ возвращает меня на страницу повторной проверки, поэтому я добавил

curl_setopt($curl, CURLOPT_COOKIE,true) ;

спасибо ребята за помощь даже если я все еще получаю пустой массив на других сайтах, которые даже не используют re-captcha