June

Version, currently master branch1 version
  • master branchlatestJan 30, 2018

github.com/codenoid/June

a Read Only Selenium for Web Scrapping

2 stars
0 dependents
License: MIT

Installation

# Add this to your shard.yml
dependencies:
  June:
    github: codenoid/June
    branch: master

master is a branch, not a release, so this tracks it rather than pinning a version.

Then run:

shards install

shard.yml

Crystal
0.24.1
License
MIT
Author
Rubi Jihantoro
Target
  • June from src/June.cr

Dependencies

This version declares no dependencies.

README

June

a READ-ONLY Selenium, with an HTTP API

Requirements

  1. Firefox Browser
  2. Geckodriver move to /usr/bin
  3. Java (tested on Java 8)
  4. Selenium

Installation

git clone https://github.com/codenoid/June.git
cd June
sudo make

Usage

  1. Start a new June server
java -jar selenium-server-standalone-3.8.1.jar & # or start inside `screen`
june --browser 2 --port 3000

--browser for starting june with 2 active browser

--port define port for HTTP API

  1. Do POST request (application/x-www-form-urlencoded) with params url
curl -d "url=https://shopee.co.id" -X POST http://localhost:3000/

Development

  • [x] Customizable
  • [x] Multiple Browser
  • [x] Balancing
  • [ ] "Remove" Requirements
  • [ ] Debug Mode
  • [ ] Validation
  • [ ] Test

Contributing

  1. Fork it ( https://github.com/codenoid/June/fork )
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create a new Pull Request

Contributors