Pinned Loading

1. Example of using Digital Ocean Space... Example of using Digital Ocean Spaces as a Spark storage with hadoop-aws library (including official AWS SDK)

   1

   // Configuring Spark Session

   2

   val hadoopConf = sparkSession.sparkContext.hadoopConfiguration

   3

   hadoopConf.set("fs.s3a.access.key", "<YOUR_ACCESS_KEY>")

   4

   hadoopConf.set("fs.s3a.secret.key", "<YOUR_SECRET_KEY>")

   5

   hadoopConf.set("fs.s3a.endpoint", "https://<REGION>.digitaloceanspaces.com") // example: "https://nyc3.digitaloceanspaces.com

2. data-hunters/metadata-digger data-hunters/metadata-digger Public

   Big Data tool for metadata extraction (Exif), enrichment (using DeepLearning) and analysis

   Scala 30 3

3. data-hunters/metadata-digger-ai data-hunters/metadata-digger-ai Public

   Code and result files (models, etc.) related to Metadata Digger's parts using Artificial Intelligence methods.

   12 2