Sayarwa ta Zinn Digital
Kayan aikin ciro bayanan yanar gizo na musamman na Python ko Node.js da aka gina domin ingantattun shafuka, masu sarrafa nunin JS, kariya daga na'urori masu sarrafa kansu (anti-bot) da binciken shafuka masu yawa, tare da bayanan fitarwa masu tsabta a tsarin CSV, JSON ko rumbun adana bayanai da ake isarwa tsakanin kwanaki 2 zuwa 10.
Kayan aikin ciro bayanai da aka gina domin ainihin shafukan yanar gizo, ba domin gwaji ba
An gina ingantattun kayan aikin ciro bayanai a shirye don aiki ta hanyar amfani da Python ko Node.js domin jerin kayayyaki, kundayen adireshi, kasuwannin yanar gizo da kuma manhajojin shafi guda masu sauyawa (SPAs). Sakamakon yana zuwa a matsayin CSV, JSON, ko kuma a rubuta shi kai tsaye a cikin rumbun adana bayanan ku.
Abubuwan da aka shafi
Dalilin da ya sa yake da karko
Masu ɗaukar bayanai da yawa suna aiki sau ɗaya a yayin gwaji kuma su daina aiki da zarar wani shafi ya canza fasalinsa, ya toshe wakilin mai amfani, ko ya ƙara sabbin kariya. Gine-gine sun dogara ne akan zaɓuɓɓuka masu juriya, dabarun sake gwadawa, maye gurbin wakili da kuma cikakken rubuta bayanai, don haka idan wani zaɓi ya karye ko shafi ya ba da kuskure maimakon bayanai, za ku ga ainihin bayanan da suka gaza da kuma dalilin hakan, maimakon samun layuka marasa komai a shiru.
Kayan aikin da aka yi amfani da su
Python (BeautifulSoup, Scrapy, Playwright, Selenium, Requests) da Node.js (Puppeteer, Cheerio, Playwright, Axios) don ɗaukar bayanai; sauya wakilai da sauya wakilin mai amfani tare da tantance burauzar da ba ta da kai don aikin hana manhaja mai sar kanta; adanawa a CSV, JSON, Excel, Google Sheets, PostgreSQL, MySQL, MongoDB, SQLite da Airtable; tsara lokaci ta hanyar cron, GitHub Actions, AWS Lambda, Vercel Cron ko Railway; kayan aikin gini akan Docker, masu samar da VPS, AWS ko Render.
Gwaji kafin mikawa
Kowane gini yana fara gudanar da gwaji a kan ƙaramin samfuri da farko, sannan cikakken gudu tare da taƙaitaccen nasara da gazawa. Ana bincika sakamako da tsarin da ake tsammani, tare da nuna guraren da suka ɓace, kwafin layuka da kurakuran fassarawa kafin a isar da su.
Mallaka
Lambar tushe da takardun shaidar mai ɗaukar bayanai za su koma hannunku gaba ɗaya a lokacin isarwa ta ƙarshe. Yarjejeniyar rashin bayyana sirri tana nan idan an nema don ayyukan bayanai masu mahimmanci ko na gasa.
Tsawon lokaci
Basic yana ɗaukar kwanaki 2 zuwa 3, Standard kwanaki 5 zuwa 7, kuma Premium kwanaki 10.
Abin da ake buƙata daga gare ku
Aika shafin da ake buƙata da jerin bayanan da ake so, kuma ana iya shirya samfurin na'urar ciro bayanai mai aiki a cikin sa'o'i 48, kafin a buƙaci kowane biyan kuɗi, domin ku fara ganin ainihin bayanan da aka ciro daga ainihin shafin da kuka zaɓa.
$50.99
Ko biya €45.52 · £38.12 a kan farashin yau — ana kulle farashin idan ka saka shi a cikin kwandanka.
Single-site, single-page scraper with clean CSV or JSON output. - Full source code + setup - One target URL scraped - Up to 10 fields extracted per item - Static HTML parsing (no JS rendering) - CSV or JSON output - Deduplication + field normalization - Basic error handling and logging - Readme - 2 revisions
An isar cikin kwanaki 3
Gyaran da aka haɗa: 0
$125.99
Ko biya €112.47 · £94.19 a kan farashin yau — ana kulle farashin idan ka saka shi a cikin kwandanka.
Multi-page crawl with pagination, JS rendering and anti-bot handling. - Full source code + setup - One target URL scraped - Static HTML parsing (no JS rendering) - Deduplication + field normalization - Basic error handling and logging - Readme - Structured error log + retry queue - Multi-page crawl with pagination support - JavaScript-rendered pages (Puppeteer or Playwright) - Anti-bot handling — UA rotation, headers, request throttling - Proxy rotation support - Rate-limit compliance with backoff on 429/503 - Up to 25 fields per item - Unlimited records - Output to CSV, JSON, or Google Sheets - 3 revisions
An isar cikin kwanaki 7
Gyaran da aka haɗa: 0
$375.99
Ko biya €335.65 · £281.09 a kan farashin yau — ana kulle farashin idan ka saka shi a cikin kwandanka.
Full data pipeline with scheduling, database output, monitoring and dashboard. - Full source code + setup - One target URL scraped - Static HTML parsing (no JS rendering) - Deduplication + field normalization - Basic error handling and logging - Readme - Structured error log + retry queue - Multi-page crawl with pagination support - JavaScript-rendered pages (Puppeteer or Playwright) - Anti-bot handling — UA rotation, headers, request throttling - Proxy rotation support - Rate-limit compliance with backoff on 429/503 - Up to 25 fields per item - Unlimited records - Output to CSV, JSON, or Google Sheets - Priority delivery slot - Unlimited fields + custom schema mapping - Database output — PostgreSQL, MySQL, MongoDB, or SQLite - Scheduled runs — cron, GitHub Actions, AWS Lambda or Vercel - Cron Change detection between runs (new / updated / removed records) - Login-gated content support (session handling, form submission) - CAPTCHA-aware flow (manual-solve integration or third-party solver) - Docker-based deployment - Monitoring dashboard or Slack/email alerts on failure - Loom walkthrough of the full pipeline - 30 days post-delivery support - 5 revisions
An isar cikin kwanaki 10
Gyaran da aka haɗa: 0
Babu buƙatar asusun ajiya tun farko — ana ƙirƙirar naka a lokacin biya. Muna riƙe kuɗin har sai ka karɓi aikin.
A mafi yawan lokuta, e. Muna haɗa juyawar wakili (proxy rotation), bambance-bambancen user-agent, daidaita saurin buƙata (throttling) da kuma sarrafa mashigar yanar gizo ba tare da nuna shafi ba (headless browser rendering) domin shawo kan matsalolin toshewa da aka saba fuskanta. Shafukan da ke amfani da ingantattun tsare-tsaren kariya na iya ƙara kuɗin aikin, don haka muna fara duba shafin da ake son ɗauka sannan mu sanar da ku ko ya dace da daidaitaccen farashi ko kuma yana buƙatar ƙimanta farashi na musamman.
Ciro bayanai daga shafukan da kowa zai iya gani abu ne da aka fi yarda da shi a mafi yawan wurare, duk da cewa hakan ya dogara ne da ka'idojin shafin, bayanan da abin ya shafa da kuma yadda kuka yi niyyar amfani da su. Muna aiki ne kawai da shafukan da kowa zai iya gani, ba ma tsallake shingayen biyan kudi, muna guje wa tattara bayanan sirri na mutane, kuma ba za mu keta ka'idojin da suka haramta ciro bayanai ba tare da amincewarku a rubuce da izinin doka ba.
Tsarin shafuka yakan canza, kuma a sakamakon haka masu zaɓe (selectors) na iya daina aiki. Kowane scraper ya ƙunshi tsarin rubuta kuskure domin a sanar da ku da zarar wani fanni ya daina dawo da bayanai. Standard da Premium suna ƙara fasalolin juriya kamar madadin masu zaɓe da faɗakarwa don rage matsala, kuma muna ɗaukar nauyin gyare-gyaren da suka shafi tsarin shafi kyauta a cikin kwanaki 14 bayan isarwa.
Eh, ta hanyar amfani da Puppeteer, Playwright ko Selenium don sarrafa manhajoji masu shafi ɗaya, jinkirta lodi da gungurawa marar iyaka. Wannan yana cikin kunshin Standard da Premium; Basic yana iyakance ne ga tsayayyen HTML kawai.
Eh, don asusun da kuka mallaka ko aka ba ku izinin amfani da su. Kula da zama, sarrafa kuki da ƙaddamar da fom an haɗa su da Premium. Raba duk wani bayanan shiga ta hanyar da ke da tsaro; ba ma ajiye su bayan aikin ya ƙare.
Muna ba da hanyoyi guda biyu: dakatarwa don warwarewa da kanka inda za ka shiga tsakani, ko kuma amfani da sabis na warware CAPTCHA na wani daban a kan kuɗin kanka. Wannan yana cikin tsarin Premium kuma ana iya ƙara shi zuwa Standard.
I, Premium tana goyon bayan gudanarwa da aka tsara ta hanyar cron, GitHub Actions, AWS Lambda ko Vercel Cron. Kuna zaɓar yawan lokaci, ko na yau da kullun, mako-mako, kowane wata ko wani tsarin, kuma kowace gudanarwa tana rubuta sakamakonta tare da zaɓin sanarwar rashin nasara.
Kula da ƙa'idar saurin buƙata na al'ada ne: daidaita yawan buƙatu, jinkirta ƙoƙari na ninki a martanonin 429 da 503, da daidaita ayyukan lokaci ɗaya domin kasancewa a cikin ƙa'idoji. Duka Standard da Premium sun ƙunshi wannan dabarar gaba ɗaya.
Ee, ana goyon bayan shigarwa kai tsaye zuwa PostgreSQL, MySQL, MongoDB, SQLite ko Airtable. Fitar da bayanan database yana cikin Premium, yayin da Standard ya ƙunshi CSV, JSON da Google Sheets.
Babu wani ƙayyadadden iyaka; ya dogara ne da ƙa'idojin saurin shafin da kuma girman rukunin wakilai (proxy pool) da ake da su. Mun gudanar da ayyukan da suka ciro bayanan da suka haura 100,000 cikin kwanaki da dama. Don bincike mai yawa sosai, muna ba da shawarar sauya wakilai a kai a kai (proxy rotation) da kuma tsara lokutan gudanarwa don guje wa gano shirin.
Kuna karɓar cikakken mallaka a lokacin isarwa ta ƙarshe, gami da lambar tushe, bayanan shiga, tsarin aiki, da duk bayanan da aka samo, ba tare da ƙuntatawar lasisi, kuɗaɗen ci gaba, ko ɗaurewa ba.
Ana fara gudanar da kowane mai ɗibar bayanan a kan wani ɗan ƙaramin samfuri, sannan a yi cikakken aiki. Ana duba sakamakon daidai da tsarin da ake tsammani, kuma ana nuna ɓangarorin da ba a samu ba, layuka masu kwafi da kura-kuran fassara kafin a miƙa aikin, tare da rajistar kuskure da taƙaitaccen bayanin nasarori da gazawa.