Web Scraping

Logo

Repositório da turma de 6 de 2021 do curso Web scraping.

View the Project on GitHub curso-r/202106-web-scraping

Fluxo do Web Scraping.

Fluxo do Web Scraping.

Informações importantes

Dúvidas

Fora do horário de aula ou monitoria:

Slides

slide link pdf
slides/01-introducao-ao-curso.html https://curso-r.github.io/main-web-scraping/slides/01-introducao-ao-curso.html https://curso-r.github.io/main-web-scraping/slides/01-introducao-ao-curso.pdf
slides/02-introducao-ao-ws.html https://curso-r.github.io/main-web-scraping/slides/02-introducao-ao-ws.html https://curso-r.github.io/main-web-scraping/slides/02-introducao-ao-ws.pdf
slides/03-navegador.html https://curso-r.github.io/main-web-scraping/slides/03-navegador.html https://curso-r.github.io/main-web-scraping/slides/03-navegador.pdf
slides/04-auth.html https://curso-r.github.io/main-web-scraping/slides/04-auth.html https://curso-r.github.io/main-web-scraping/slides/04-auth.pdf
slides/05-html.html https://curso-r.github.io/main-web-scraping/slides/05-html.html https://curso-r.github.io/main-web-scraping/slides/05-html.pdf
slides/06-path.html https://curso-r.github.io/main-web-scraping/slides/06-path.html https://curso-r.github.io/main-web-scraping/slides/06-path.pdf
slides/07-iteracao.html https://curso-r.github.io/main-web-scraping/slides/07-iteracao.html https://curso-r.github.io/main-web-scraping/slides/07-iteracao.pdf
slides/08-webdriver.html https://curso-r.github.io/main-web-scraping/slides/08-webdriver.html https://curso-r.github.io/main-web-scraping/slides/08-webdriver.pdf

Scripts utilizados em aula

Aqui colocamos scripts utilizados em aula que são novos ou que são versões modificadas do material básico da aula.

script link
01-pokemon.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/01-pokemon.R
02-sabesp.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/02-sabesp.R
03-sptrans.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/03-sptrans.R
04-twitter.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/04-twitter.R
05-covid.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/05-covid.R
06-html.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/06-html.R
07-chancedegol.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/07-chancedegol.R
08-tjsp.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/08-tjsp.R
09-discourse.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/09-discourse.R
10-wiki.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/10-wiki.R
12-jobs.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/12-jobs.R
13-pesqele.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/13-pesqele.R
14-pbi.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/14-pbi.R
15-gh-actions.yml https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/15-gh-actions.yml
16-tjba.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/16-tjba.R
17-mp.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/17-mp.R
18-esalq.R https://curso-r.github.io/202106-web-scraping/exemplos_de_aula/18-esalq.R

Lição de casa

nome link
exercicios/01-pokemon.R https://curso-r.github.io/main-web-scraping/exercicios/01-pokemon.R
exercicios/02-sabesp.R https://curso-r.github.io/main-web-scraping/exercicios/02-sabesp.R
exercicios/03-sptrans.R https://curso-r.github.io/main-web-scraping/exercicios/03-sptrans.R
exercicios/04-twitter.R https://curso-r.github.io/main-web-scraping/exercicios/04-twitter.R
exercicios/05-covid.R https://curso-r.github.io/main-web-scraping/exercicios/05-covid.R
exercicios/06-html.R https://curso-r.github.io/main-web-scraping/exercicios/06-html.R
exercicios/07-chancedegol.R https://curso-r.github.io/main-web-scraping/exercicios/07-chancedegol.R
exercicios/08-tjsp.R https://curso-r.github.io/main-web-scraping/exercicios/08-tjsp.R
exercicios/10-wiki.R https://curso-r.github.io/main-web-scraping/exercicios/10-wiki.R
exercicios/11-dejt.R https://curso-r.github.io/main-web-scraping/exercicios/11-dejt.R
exercicios/12-jobs.R https://curso-r.github.io/main-web-scraping/exercicios/12-jobs.R
exercicios/13-pesqele.R https://curso-r.github.io/main-web-scraping/exercicios/13-pesqele.R
exercicios/14-pbi.R https://curso-r.github.io/main-web-scraping/exercicios/14-pbi.R
exercicios/16-tjba.R https://curso-r.github.io/main-web-scraping/exercicios/16-tjba.R

Trabalhos finais premiados

(em breve)

Material extra

Referências extras comentadas nas aulas.

Aula Tema Descrição
0 janitor Pacote janitor no livro da curso-r
1 organizacao Slides de pacotes
1 organizacao Livro Zen do R
1 organizacao Livro R Packages
1 leitura Artigo do Hadley sobre Tidy Data
2 organizacao Exemplo de documentação de dados
2 exemplo Exemplo de pacote com automação
2 leitura Como instalar o rJava
3 leitura Aula sobre Regex
4 leitura Agendando scripts com cronR
4 exemplo Trabalho do Marcello Filgueiras
4 leitura Um pouco mais sobre o progressr
5 leitura Material sobre xpath
5 leitura Documentação do RSelenium
5 leitura Comparação BI e Shiny
6 video Github Actions
6 leitura Github Actions

Redes sociais da Curso-R

Instagram: https://www.instagram.com/cursoo_r/

Twitter: https://twitter.com/curso_r

Youtube: https://www.youtube.com/c/CursoR6/featured

Linkedin: https://www.linkedin.com/company/curso-r/

Facebook: https://www.facebook.com/cursodeR