Initial commit

Author: ItzCrazyKns

.assets/perplexica-preview.gif

@@ -0,0 +1,4 @@
+PORT=3001
+OPENAI_API_KEY=
+SIMILARITY_MEASURE=cosine # cosine or dot
+SEARXNG_API_URL= # no need to fill this if using docker

.assets/perplexica-screenshot.png

@@ -0,0 +1,35 @@
+# Node.js
+node_modules/
+npm-debug.log
+yarn-error.log
+
+# Build output
+/.next/
+/out/
+
+# IDE/Editor specific
+.vscode/
+.idea/
+*.iml
+
+# Dependency lock files
+package-lock.json
+yarn.lock
+
+# Environment variables
+.env
+.env.local
+.env.development.local
+.env.test.local
+.env.production.local
+
+# Log files
+logs/
+*.log
+
+# Testing
+/coverage/
+
+# Miscellaneous
+.DS_Store
+Thumbs.db

.env.example

@@ -0,0 +1,12 @@
+/** @type {import("prettier").Config} */
+
+const config = {
+  printWidth: 80,
+  trailingComma: 'all',
+  endOfLine: 'auto',
+  singleQuote: true,
+  tabWidth: 2,
+  semi: true,
+};
+
+module.exports = config;

.gitignore

@@ -0,0 +1,74 @@
+# 🚀 Perplexica - An AI-powered search engine 🔎
+
+![preview](.assets/perplexica-screenshot.png)
+
+## Overview
+
+Perplexica is an open-source AI-powered searching tool or an AI-powered search engine that goes deep into the internet to find answers. Inspired by Perplexity AI, it's an open-source option that not just searches the web but understands your questions. It uses advanced machine learning algorithms like similarity searching and embeddings to refine results and provides clear answers with sources cited.
+
+## Preview
+![video-preview](.assets/perplexica-preview.gif)
+
+## Features
+
+- **Two Main Modes:**
+  - **Copilot Mode:** (In development) Boosts search by generating different queries to find more relevant internet sources. Like normal search instead of just using the context by SearxNG, it visits the top matches and tries to find relevant sources to the user's query directly from the page.
+  - **Normal Mode:** Processes your query and performs a web search.
+- **Focus Modes:** (In development) special modes to better answer specific types of questions.
+- **Current Information:** Some search tools might give you outdated info because they use data from crawling bots and convert them into embeddings and store them in a index (its like converting the web into embeddings which is quite expensive.). Unlike them, Perplexica uses SearxNG, a metasearch engine to get the results and rerank and get the most relevent source out of it, ensuring you always get the latest information without the overhead of daily data updates.
+
+It has many more features like image and video search. Some of the planned features are mentioned in [upcoming features](#upcoming-features).
+
+## Installation
+
+There are mainly 2 ways of installing Perplexica - With Docker, Without Docker. Using Docker is highly recommended.
+
+### Getting Started with Docker (Recommended)
+
+1. Make sure Docker is installed and running on your system.
+2. Clone the Perplexica repository:
+
+```bash
+git clone https://github.com/ItzCrazyKns/Perplexica.git
+```
+
+3. After cloning, rename the `.env.example` file to `.env` in the root directory. For Docker setups, you only need to fill these fields:
+
+- `OPENAI_API_KEY`
+- `SIMILARITY_MEASURE` (Its filled by default, you can leave it if you do not know about it.)
+
+4. Navigate to the directory containing `docker-compose.yaml` and execute:
+
+```bash
+docker compose up
+```
+
+5. Wait a few minutes for the setup to complete. Access Perplexica at `http://localhost:3001` in your web browser.
+
+### Non-Docker Installation
+
+For setups without Docker:
+
+1. Follow the initial steps to clone the repository and rename the `.env.example` file to `.env` in the root directory. You will need to fill in all the fields in this file.
+2. Additionally, rename the `.env.example` file to `.env` in the `ui` folder and complete all fields.
+3. The non-Docker setup requires manual configuration of both the backend and frontend.
+
+**Note**: Using Docker is recommended as it simplifies the setup process, especially for managing environment variables and dependencies.
+
+## Upcoming Features
+
+- Finalizing Copilot Mode
+- Adding support for multiple local LLMs and LLM providers such as Anthropic, Google, etc.
+- Adding Discover and History Saving features
+- Introducing various Focus Modes
+- Continuous bug fixing
+
+## Contribution
+
+Perplexica is built on the idea that AI and large language models should be easy for everyone to use. If you find bugs or have ideas, please share them in via GitHub Issues. Details on how to contribute will be shared soon.
+
+## Acknowledgements
+
+Inspired by Perplexity AI, Perplexica aims to provide a similar service but always up-to-date and fully open source, thanks to SearxNG.
+
+If you have any queries you can reach me via my Discord - `itzcrazykns`. Thanks for checking out Perplexica.

.prettierrc.js

@@ -0,0 +1,15 @@
+FROM node:alpine
+
+ARG NEXT_PUBLIC_WS_URL
+ARG NEXT_PUBLIC_API_URL
+ENV NEXT_PUBLIC_WS_URL=${NEXT_PUBLIC_WS_URL}
+ENV NEXT_PUBLIC_API_URL=${NEXT_PUBLIC_API_URL}
+
+WORKDIR /home/perplexica
+
+COPY ui /home/perplexica/
+
+RUN yarn install
+RUN yarn build
+
+CMD ["yarn", "start"]

README.md

@@ -0,0 +1,17 @@
+FROM node:alpine
+
+ARG SEARXNG_API_URL
+ENV SEARXNG_API_URL=${SEARXNG_API_URL}
+
+WORKDIR /home/perplexica
+
+COPY src /home/perplexica/src
+COPY tsconfig.json /home/perplexica/
+COPY .env /home/perplexica/
+COPY package.json /home/perplexica/
+COPY yarn.lock /home/perplexica/
+
+RUN yarn install
+RUN yarn build
+
+CMD ["yarn", "start"]

app.dockerfile

@@ -0,0 +1,44 @@
+services:
+  searxng:
+    build:
+      context: .
+      dockerfile: searxng.dockerfile
+    expose:
+      - 4000
+    ports:
+      - 4000:8080
+    networks:
+      - perplexica-network
+  perplexica-backend:
+    build:
+      context: .
+      dockerfile: backend.dockerfile
+      args:
+        - SEARXNG_API_URL=http://searxng:8080
+    depends_on:
+      - searxng
+    expose:
+      - 3001
+    ports:
+      - 3001:3001
+    networks:
+      - perplexica-network
+
+  perplexica-frontend:
+    build:
+      context: .
+      dockerfile: app.dockerfile
+      args:
+        - NEXT_PUBLIC_API_URL=http://127.0.0.1:3001/api
+        - NEXT_PUBLIC_WS_URL=ws://127.0.0.1:3001
+    depends_on:
+      - perplexica-backend
+    expose:
+      - 3000
+    ports:
+      - 3000:3000
+    networks:
+      - perplexica-network
+
+networks:
+  perplexica-network:

backend.dockerfile

@@ -0,0 +1,32 @@
+{
+  "name": "perplexica-backend",
+  "version": "1.0.0",
+  "license": "MIT",
+  "author": "ItzCrazyKns",
+  "scripts": {
+    "start": "node --env-file=.env dist/app.js",
+    "build": "tsc",
+    "dev": "nodemon --env-file=.env src/app.ts",
+    "format": "prettier . --check",
+    "format:write": "prettier . --write"
+  },
+  "devDependencies": {
+    "@types/cors": "^2.8.17",
+    "@types/express": "^4.17.21",
+    "@types/readable-stream": "^4.0.11",
+    "prettier": "^3.2.5",
+    "ts-node": "^10.9.2",
+    "typescript": "^5.4.3"
+  },
+  "dependencies": {
+    "@langchain/openai": "^0.0.25",
+    "axios": "^1.6.8",
+    "compute-cosine-similarity": "^1.1.0",
+    "compute-dot": "^1.1.0",
+    "cors": "^2.8.5",
+    "express": "^4.19.2",
+    "langchain": "^0.1.30",
+    "ws": "^8.16.0",
+    "zod": "^3.22.4"
+  }
+}