Multiplatform framework for web scraping, designed to retrieve, standardize, and relay public information from websites. Supports integration via Maven and Gradle, encouraging community contributions.
Kotlin Multiplatform Scraping Framework
shovel is a Kotlin Multiplatform framework for scraming web applications.
It is used in The Earth App to retrieve, standardize, and relay public information and websites.
Maven (JVM)
<dependencies>
<dependency>
<groupId>com.earth-app.shovel</groupId>
<artifactId>shovel-jvm</artifactId>
<version>[VERSION]</version> <!-- Replace with latest version -->
</dependency>
</dependencies>
Gradle (Groovy, JVM)
dependencies {
implementation "com.earth-app.shovel:shovel-jvm:[VERSION]" // Replace with latest version
}
Gradle (Kotlin DSL, Multiplatform)
kotlin {
jvm()
js()
linuxX64()
sourceSets {
val commonMain by getting {
dependencies {
implementation("com.earth-app.shovel:shovel:[VERSION]") // Replace with latest version
}
}
}
}
Contributions are welcome. Please fork this repository and submit a pull request for any changes you would like to make.
Surfaced from shared tags and platforms — no rankings paid for.