Made a library? Written a blog post? Found a useful tutorial? Share it with the Go community here or just enjoy what everyone else has found!
This blog features multiple posts regarding building Python web crawlers, but the subject of building a crawler in Golang has never been touched upon. There are a couple of frameworks for building web crawlers in Golang, but today we are going to look at building a web crawler using Colly. When I first started playing with the framework, I was shocked how quick and easy it was to build a highly functional crawler with very few lines of Go code.
Project Flogo is an open source framework to simplify building efficient & modern serverless functions and edge microservices.
Visit the Project Repo on GitHub: https://github.com/TIBCOSoftware/flogo
🎈 Ultra-light process engine 20x-50x lighter than Java or NodeRed
🌈 Painless development Visual modeler & elegant DSL
⚡️ Event driven by design for Function as a Service (FaaS)
⚙️ Edge deployment model Static binaries for painless edge deployments
🏘 Extensible & reusable by design to build your own apps, frameworks & platforms
🎉 100% Open Source for your dev & hacking pleasure
gokrazy is a pure-Go userland for your Raspberry Pi 3 appliances.
For a long time, we were unhappy with having to care about security issues and Linux distribution maintenance on our various Raspberry Pis.
Then, we had a crazy idea: what if we got rid of memory-unsafe languages and all software we don’t strictly need?
Turns out this is feasible. gokrazy is the result.
Comprehensive article about web scraping with Go using ONLY the standard library! It talks about the ethics of scraping, setting HTTP headers, making GET requests, using cookies, logging into websites and several other topics related to web scraping. John Daniel Leon explains clearly and offers ample code examples.