Re: struck at gettiing each product urls from addidas website

Hi previous one prints nothing 

and this is another way but getting nothing 

import requests

from bs4 import BeautifulSoup

base_url="https://www.adidas.com.my/en/men-shoes/"

headers = {

    'User-Agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36'

}

for x in range(0,18):

    x=x*(12*4)

    r = requests.get(f'https://www.adidas.com.my/en/men-shoes?start={x}')

    soup = BeautifulSoup(r.content,'lxml')

    productlist = soup.find_all('div', class_='grid-item___3rAkS')

    productlinks=[]

    for item in productlist:

        for link in item.find_all('a',href=True):

            productlinks.append(base_url+ link['href'])

print(productlinks)

thanks 

On Tue, Jun 22, 2021 at 9:52 AM Lalit Suthar <sutharlalit.97@gmail.com> wrote:

print(links) outside for loop. Even then if nothing prints means your `listings` is empty

On Tue, 22 Jun 2021 at 08:51, ram manoj Vuyyuru <rammanojvuyyuru@gmail.com> wrote:

HI 

help me for getting urls for each product 

import pandas as pd

import requests

from bs4 import BeautifulSoup as bs 

url = "https://www.adidas.com.my/en/men-shoes?start=0"

page = requests.get(url)

soup = bs(page.text,"html.parser")

links=[]

listings = soup.find_all('div',{'class':'grid-item___3rAkS'})

for listing in listings:

    shoes_link= listing.find_all("a").a.get("href")

    base_url="https://www.adidas.com.my/en/men-shoes/"

    cmplt_lnk=base_url+shoes_link

    links.append(cmplt_lnk)

    print(links)

 

my code :

when i run this i am not getting any result 

--
You received this message because you are subscribed to the Google Groups "Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to django-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/django-users/CALJzFip9tmQTxygmWpqpc%3DqKHipNNf4HXhofGFXOPy3pp4bMCw%40mail.gmail.com.

--
You received this message because you are subscribed to the Google Groups "Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to django-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/django-users/CAGp2JVH%2BioS8doxM77s8BPjZjkc-hh7YrXecVO4fztwgFSPjWw%40mail.gmail.com.

--
You received this message because you are subscribed to the Google Groups "Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to django-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/django-users/CALJzFioVAbjZyaacEyc%2BjhbdRa1V7GmFTdd8eBC%3Dp-oN0sWpfg%40mail.gmail.com.