cr_manga_downloadr
Version, currently master branch1 version
- master branchlatestJul 7, 2017
github.com/akitaonrails/cr_manga_downloadr
Second version of the Ruby version of my MangaReader.net crawler adapted for Crystal
18 stars
0 dependents
License: MIT
Installation
# Add this to your shard.yml
dependencies:
cr_manga_downloadr:
github: akitaonrails/cr_manga_downloadr
branch: mastermaster is a branch, not a release, so this tracks it rather than pinning a version.
Then run:
shards installshard.yml
- Crystal
- no constraint declared
- License
- MIT
- Author
- AkitaOnRails <fabioakita@gmail.com>
Dependencies
Runtime Dependencies
- fiberpool*github: akitaonrails/fiberpool
- cr_chainable_methods*github: akitaonrails/cr_chainable_methods
Development Dependencies
- webmock*github: manastech/webmock.cr, branch: masterdev
README
# Crystal - MangaReader Downloader
I did a Ruby version of a MangaReader crawler using Typhoeus. The code got really convoluted and I never properly refactored it.
The original code is here:
https://github.com/akitaonrails/manga-downloadr
I also did a better structured Elixir version here:
https://github.com/akitaonrails/ex_manga_downloadr
## Installation
You will need to install ImageMagick in your system (to resize images to Kindle format and merge them into PDF volumes). Refer to your system's particular install. In Ubuntu, simply do:
sudo apt-get install imagemagick
To set up the development environment install the dependencies:
crystal deps
crystal build src/cr_manga_downloadr.cr --release
## Usage
Once you have the compiled binary just use like this:
./cr_manga_downloadr -u http://www.mangareader.net/onepunch-man -d /tmp/onepunch-man
In this example, all the pages of the "One Punch Man" will be downloaded to the directory "/tmp/onepunch-man" and they will have the following filename format:
/tmp/onepunch-man/Onepunch-Man-Chap-00038-Pg-00011.jpg
Chapters and Pages numbers will be properly left-padded with zeroes so the filesystem can sort them correctly.
You can also use the flag `--cache` or just `-c` to turn on the HTTP cache, that way you can Ctrl-C in the middle of the process and resume later where you left off.
## Development
You can run the specs like this:
crystal spec
If you want to benchmark against the other implementations of the downloader you can use the test mode like this:
time ./cr_manga_downloadr --test
And you can test with cache turned on as well:
time ./cr_manga_downloadr --test --cache
This will use the One-Punch Man manga as the test sample.
## Contributing
1. Fork it ( https://github.com/akitaonrails/cr_manga_downloadr/fork )
2. Create your feature branch (git checkout -b my-new-feature)
3. Commit your changes (git commit -am 'Add some feature')
4. Push to the branch (git push origin my-new-feature)
5. Create a new Pull Request
## Contributors
- [AkitaOnRails](https://github.com/akitaonrails) - creator, maintainer
Documentation
Built from the current release. The first visit to a release nobody has asked for starts its build.
Links
This branch
- Branch
master- Seen
- Jul 7, 2017
- Indexed
- yes
Dependents
No indexed shard depends on this one yet.
Repository
github.com/akitaonrails/cr_manga_downloadr
Metadata
- Created
- Aug 12, 2026
- Updated
- Aug 13, 2026
- Synced
- Aug 13, 2026
- Versions
- 1