Build a Web Scraper with Angular 2 & GO17 Nov 2016 @ Balai Kartini

Sigit Prayoga

Sigit Prayoga.Initiator of JLP

People Development Manager @ Obortech

Just about 6 years experience.Worked onsite with TiVo, Best Buy, JC

Penney & JPMC.

gh: @sigit-prayoga

[DEMO]

Simple, huh?

1.Bootstrap Angular 2 App with angular-cli

2. Create http request di Angular 2

3. Create a RESTful API

4. Web Scraping with GoQuery

5. Build and run GO

1.Bootstrap Angular 2 App with angular-cli

2.Create http request di Angular 23.Create a RESTful API4.Web Scraping with GoQuery5.Build and run GO

In common practice what do we need?

Database || Open API

Database

[{“name”:”iPhone 7 White 128 GB”,“description”:”lorem ipsum

lorem”,“categories”:[cat1, cat2, cat3,

cat4]},{

“Name”:”lemari baju”,“description”:”lorem ipsum

lorem”,“categories”:[cat1, cat2, cat3,

cat4]},{

“Name”:”sepatu lari”,“description”:”lorem ipsum

lorem”,“categories”:[cat1, cat2, cat3,

cat4]}]

Frontend Backend Database

So, let’s input all products then?

OPEN API

Application Program Interface

Open for public usage?

No database, No open API?!

No worries

Let’s scrap this sh*t!

Note: Only for sharing purpose. More research required about the legality before you really want to do this.

What is web scraping?

How about searching category?

[..SEE THE CODE..]

https://github.com/sigit-prayoga/web-scraper-angular2

Questions?