Mobile Specification Scraper

A specialized web scraper designed to extract mobile device specifications from Mobiledokan and seamlessly integrate them with the Arena Products Store (APS) WordPress plugin.

📋 Prerequisites

Before you begin, make sure your setup includes the following:

• Node.js: Install the latest version (Download here)
• WordPress: A fresh and ready-to-use installation (WordPress)
• Duplicator Pro: Backup and migration plugin for WordPress (Get Duplicator Pro)
• Arena Products Store: Installed and activated WordPress plugin (Available on CodeCanyon)

---

🚀 Installation

Follow these steps to set up the local scraping environment:

1. Clone the Repository

   git clone https://github.com/nfsnayem/Scraper.git

2. Navigate to the Directory

   cd Scraper

3. Install Dependencies

   npm install

4. Start the Server

   npm start

Tip

The local server will be accessible at http://localhost:3080.

---

⚙️ WordPress Setup and Configuration

Start with a fresh and ready-to-use WordPress installation:

• Go to Plugins → Add New → Upload Plugin
• Upload the Duplicator Pro plugin file and click Activate
• Download the Duplicator backup ZIP file by clicking the provided link
• In your WordPress dashboard, open Duplicator Pro and navigate to the Import section
• Upload the downloaded tech_duplicator ZIP file
• Select the tech_duplicator package and begin the restoration process

Once the Restoration is Complete, Generate an Application Password in WordPress:

1. Log in to your WordPress dashboard.
2. Navigate to Users.
3. Click on Edit User.
4. Scroll down to the Application Passwords section.
5. Enter a name for your application in the New Application Password Name field.
6. Click on Add New Application Password.
7. Copy the generated password.

Warning

Make sure to save this password in a secure location. You will not be able to view it again after leaving the page.

---

🛠️ Scraper Setup and Configuration

Once you have downloaded the project, follow these steps:

• Open the project folder in the VS Code editor.
• Inside, you will find a file named env.example.
• Rename env.example to .env.
• Open the .env file. It will look like this:

APP_RUNNING_PORT=3030
WP_SITE_URL='https://www.yourdomain.com'
WP_API_URL='https://www.yourdomain.com/wp-json/wp/v2/media'
WP_USER='user name'
WP_APP_PASSWORD='xxxxxxxxxxx'

Replace the values with your own credentials and configuration:

• APP_RUNNING_PORT → Your preferred port number
• WP_SITE_URL → Your WordPress site URL
• WP_API_URL → Your WordPress media API endpoint
• WP_USER → Your WordPress username
• WP_APP_PASSWORD → The application password you generated earlier

Tip

Congratulations! Your local setup is now ready to go.

---

🧩 Extension Setup and Configuration

The scraper uses a dedicated browser extension to trigger data extraction directly from the source site.

1. Open your browser and navigate to the Extensions page (e.g., chrome://extensions).
2. Enable Developer mode (toggle in the top right).
3. Click Load unpacked.
4. Select the extension folder from your local repository: \scraper\extension
5. Navigate to any Mobiledokan device page and click the extension icon to begin.

Caution

This application is strictly compatible with Mobiledokan URLs. Attempting to scrape other domains may result in errors.

---

⚙️ Automation (Windows)

For a faster workflow, use the provided batch file to bypass manual terminal commands:

1. Right-click executor.bat and select Edit.
2. Replace the placeholder path with your actual local project path.
3. Save and double-click the file to launch the server automatically.

---

Tamim Hossain – Thank you for your valuable contributions and support!