fanfiction | Scraping tools for fanfiction.net | Machine Learning library

by smilli Python Version: 0.1.1 License: No License

X-Ray Key Features Code Snippets(3)Community Discussions(4)Vulnerabilities Install Support

kandi X-RAY | fanfiction Summary

fanfiction is a Python library typically used in Artificial Intelligence, Machine Learning applications. fanfiction has no bugs, it has no vulnerabilities, it has build file available and it has low support. You can install using 'pip install fanfiction' or download it from GitHub, PyPI.

This repository contains scraping tools for FanFiction.Net. These tools are meant to be used for non-commercial, research purposes. They were originally created for the following paper; please cite if you use this software for your research:. Smitha Milli and David Bamman, "Beyond Canonical Texts: A Computational Analysis of Fanfiction" EMNLP 2016.

Support

Quality

Security

License

Reuse

Support

fanfiction has a low active ecosystem.

It has 36 star(s) with 17 fork(s). There are 7 watchers for this library.

It had no major release in the last 12 months.

There are 2 open issues and 1 have been closed. On average issues are closed in 20 days. There are 2 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of fanfiction is 0.1.1

Quality

fanfiction has 0 bugs and 2 code smells.

Security

fanfiction has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

fanfiction code analysis shows 0 unresolved vulnerabilities.

There are 1 security hotspots that need review.

License

fanfiction does not have a standard license declared.

Check the repository for any license declaration and review the terms closely.

Without a license, all rights are reserved, and you cannot use the library in your applications.

Reuse

fanfiction releases are not available. You will need to build from source code and install.

Deployable package is available in PyPI.

Build file is available. You can build the component from source.

Installation instructions are not available. Examples and code snippets are available.

fanfiction saves you 49 person hours of effort in developing the same functionality from scratch.

It has 129 lines of code, 6 functions and 3 files.

It has high code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi has reviewed fanfiction and discovered the below as its top functions. This is intended to give you an instant insight into fanfiction implemented functionality, and help decide if they suit your requirements.

Scrape a story
Scrape story metadata
Scrape reviews for a chapter
Convert a genre text into a list of genres
Scrape a chapter

Get all kandi verified functions for this library.

fanfiction Key Features

No Key Features are available at this moment for fanfiction.

fanfiction Examples and Code Snippets

Documentation

Python

Lines of Code : 4

License : No License

Copy

fanfiction.Scraper.get_story_metadata(story_id)

fanfiction.Scraper.scrape_story(story_id, keep_html=False)

fanfiction.Scraper.scrape_chapter(story_id, chapter_id, keep_html=False)

fanfiction.Scraper.scrape_reviews_for_chapter(story_id, chapter_id)

Usage,Example

Python

Lines of Code : 3

License : No License

Copy

from fanfiction import Scraper
scraper = Scraper()
metadata = scraper.scrape_story_metadata(STORY_ID)

Usage,Install

Python

Lines of Code : 1

License : No License

Copy

pip install fanfiction

Community Discussions

Trending Discussions on fanfiction

How to Go to New WordPress Post After Programmatically Creating It?

Cloudflare and Chromedriver - cloudflare distinguishes between chromedriver and genuine chrome?

Python requests like a browser?

How can I make a Tkinter GUI that auto fills certain entries

QUESTION

How to Go to New WordPress Post After Programmatically Creating It?

Asked 2021-Apr-01 at 14:02

I created a PHP function that will automatically create a new WordPress post based on content added onto a page. However, it just stays on the current page but I want it to go to that new created post. How could I redirect so that it goes to that post? Here's what I have so far:

...

ANSWER

Answered 2021-Apr-01 at 14:02

You can use get_permalink to get post url. check below code.

Source https://stackoverflow.com/questions/66905915

QUESTION

Cloudflare and Chromedriver - cloudflare distinguishes between chromedriver and genuine chrome?

Asked 2021-Jan-08 at 23:51

I would like to use chromedriver to scrape some stories from fanfiction.net. I try the following:

...

ANSWER

Answered 2021-Jan-08 at 23:51

This error message...

...implies that the Cloudflare have detected your requests to the website as an automated bot and subsequently denying you the access to the application.

Solution

In these cases the a potential solution would be to use the undetected-chromedriver to initialize the Chrome Browsing Context.

undetected-chromedriver is an optimized Selenium Chromedriver patch which does not trigger anti-bot services like Distill Network / Imperva / DataDome / Botprotect.io. It automatically downloads the driver binary and patches it.

Code Block:

Source https://stackoverflow.com/questions/65636102

QUESTION

Python requests like a browser?

Asked 2021-Jan-08 at 14:04

I want to get a webdocument from 'https://www.fanfiction.net/s/5218118/1/', but I am sadly unable to replicate the behaviour of my browser - the server always sends me something along the lines of "please enable cookies" or "complete Captcha". Is there a way to send requests like a browser, so the server delivers me the same document as if I am a browser? I already googled and tried to integrate cookies and a fake Useragent. Here is my code:

...

ANSWER

Answered 2021-Jan-08 at 14:04

Saw your EDIT but just in case, ...

Simple example with selenium, that give you the storytext

Source https://stackoverflow.com/questions/65626366

QUESTION

How can I make a Tkinter GUI that auto fills certain entries

Asked 2020-Jun-18 at 08:06

I am trying to make a GUI with Tkinter that allows you to enter either a URL or an ID.

Example URL: https://www.fanfiction.net/s/10030860/1/The-Final-Battle Example ID: 10030860

As you can see, the ID is embedded in the URL. I want to have two entries, one for entering a URL and one for entering an ID. If a user fills in the URL box, the ID is automatically generated. (If I put the example URL in the URL entry box, I want the example ID in the ID box automatically generated and vice versa) If a user fills in the ID box, the URL is automatically generated.

More examples: (The brackets are pretending to entry boxes)

...

ANSWER

Answered 2020-Jun-18 at 03:40

Better do the auto fill when Enter key is pressed in the entry box instead of using .after().

Source https://stackoverflow.com/questions/62441132

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install fanfiction

You can install using 'pip install fanfiction' or download it from GitHub, PyPI.
You can use fanfiction like any standard Python library. You will need to make sure that you have a development environment consisting of a Python distribution including header files, a compiler, pip, and git installed. Make sure that your pip, setuptools, and wheel are up to date. When using pip it is generally recommended to install packages in a virtual environment to avoid changes to the system.