[파이썬] 구글 크롤링 시 UserAgent 및 Coockie 설정 하자

크롤링 시 User-Agent 및 Cookie를 설정한다. 막히게 되면 Cookie 값을 갱신해주자

headers = {'User-Agent': "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/102.0.5005.63 Safari/537.36",
           'Cookie': 'GSP=A=7_cV4w:CPTS=1654785473:LM=1654785473:S=n9a7P7syvEx3nONo; NID=511=MyGhFfwN2Y_7VS3Uf5iH34nuwysQS2BKgP5rIg3unnXniEC0D96W480QTrgX5u0ZpK85OrRfTt4-qvX_gcM11bpdbxPN0ApykvA3t_PBg14yAx0QrRhvVIPuwoV-FAoojLAnDzEetxw2yS2bziMHclZ6-wJg_34G6O5r4to4uJU'

           }

response = requests.get(a_url, headers=headers)