Web Scraping

copy markdown

AI web scraping that self-heals with built in residential proxies and browser infrastructure to scrape any site at scale.

Built in residential proxies that automatically rotates when needed and handle bot blocks
AI human behavior simulation and interactions with the site
Automatically scale up or down browser infrastructure based on usage with no concurrency limits

Interfaze SDK

Vercel AI SDK

LangChain SDK

import { responseFormat } from "interfaze";
import { z } from "zod";

const LinkedInProfileSchema = z.object({
	first_name: z.string(),
	last_name: z.string(),
	location: z.string(),
	latest_education: z.string(),
	current_job: z.string(),
	followers: z.number(),
});

const response = await interfaze.chat.completions.create({
	messages: [
		{
			role: "user",
			content: "Extract information from https://www.linkedin.com/in/yoeven/",
		},
	],
	response_format: responseFormat(z.toJSONSchema(LinkedInProfileSchema), "linkedin_profile_schema"),
});

console.log(JSON.parse(response.choices[0]?.message.content ?? "{}"));

console.log("Web Scrape Results:", response.precontext?.[0]?.result);

JSON output

Scrape ecommerce sites

Interfaze SDK

Vercel AI SDK

LangChain SDK

import { responseFormat } from "interfaze";
import { z } from "zod";

const ProductSchema = z.object({
	price: z.number(),
	listing_name: z.string(),
});

const response = await interfaze.chat.completions.create({
	messages: [
		{
			role: "user",
			content:
				"Extract the information from https://www.amazon.com/Nintendo-SwitchTM-Neon-Blue-Joy%25E2%2580%2591ConTM-Switch/dp/B0BFJWCYTL?sr=8-2",
		},
	],
	response_format: responseFormat(z.toJSONSchema(ProductSchema), "product_schema"),
});

console.log(JSON.parse(response.choices[0]?.message.content ?? "{}"));

console.log("Web Scrape Results:", response.precontext?.[0]?.result);

JSON output

Web scrape raw outputs

Running Web scrape as a tasks with <task>scraper</task> in the system message make it faster and cheaper with a fixed structured output that's pre-defined.

Learn more about running a task.

Interfaze SDK

Vercel AI SDK

LangChain SDK

const result = await interfaze.tasks.scrape("https://news.ycombinator.com");

console.log("Web Scrape Results:", result);

JSON output

Speech-to-Text (STT)