Elvina Amirkhanova EXPERT
Editor of the portal Otzyvmarketing.ru. I have been working in the field of internet marketing since 2010.
Share
Article last updated: December 24, 2020
Share this article with friends and colleagues
Parsing is a process in which a special program collects data about social network users such as gender, age, interests, hobbies, place of residence and many other facts. Using audience parsing, you can collect and structure the necessary information, analyze it, and subsequently use it to attract the audience’s attention to your product.
In addition, you can collect a database of subscribers from competitors, and use it to launch advertising that is most likely to work.
Get up to 18% of your expenses on contextual and targeted advertising!
We recommend:
Click.ru – marketplace of advertising platforms:
- More than 2,000 advertising agencies and freelancers are already working with the service and receiving compensation.
- You can connect yourself in 1 day.
- Earn from the first ruble spent, without initial restrictions, without an entry barrier.
- Payments via WebMoney, to a card to an individual, reinvestment in advertising.
- You still have direct access to advertising accounts, a paradise for accounting for document flow and payments.
Go to website
How parsing works on VKontakte
Before launching a special program, you need to know your target audience: approximate age, gender, interests, place of residence, and so on. It is also necessary to determine the topic of the groups in which you go to parse the audience. In the program, build criteria for selecting an audience based on dozens of parameters, and put it to work.
Usually, users are found by keywords, by active behavior in the community, for example, likes, reposts and comments, and they also collect new members of the group, weed out bots and deleted accounts, and select administrators and community leaders. As a result, there will be a ready-made list with user pages that can be used to set up retargeting on VKontakte. Below we have collected 10 services with which you can parse users of VKontakte groups.
Types of parsers by technology
Browser extensions
There are many browser extensions for data parsing that collect the necessary data from the source code of pages and allow you to save it in a convenient format (for example, XML or XLSX).
Parser extensions are a good option if you need to collect small amounts of data (from one or a couple of pages). Here are popular parsers for Google Chrome:
- Parsers;
- Scraper;
- Data Scraper;
- Kimono.
Excel add-ins
Software as an add-in for Microsoft Excel. For example, ParserOK. Such parsers use macros - the parsing results are immediately uploaded to XLS or CSV.
Google Sheets
Using two simple formulas and Google Sheets, you can collect any data from websites for free.
These formulas are IMPORTXML and IMPORTHTML.
IMPORTXML
The function uses the XPath query language and allows you to parse data from XML feeds, HTML pages and other sources.
This is what the function looks like:
IMPORTXML("https://site.com/catalog"; "//a/@href")
The function takes two values:
- a link to the page or feed from which you want to get data;
- the second value is an XPath query (a special query that specifies which data element needs to be parsed).
The good news is that you don't have to learn XPath query syntax. To get an XPath query for an element with data, you need to open the developer tools in the browser, right-click on the desired element and select: Copy → Copy XPath .
Using IMPORTXML you can collect almost any data from HTML pages: titles, descriptions, meta tags, prices, etc.
IMPORTHTML
This feature has fewer capabilities - it can be used to collect data from tables or lists on a page. Here is an example of the IMPORTHTML function:
IMPORTHTML("https://https://site.com/catalog/sweets"; "table"; 4)
It takes three values:
- A link to the page from which you want to collect data.
- Parameter of the element that contains the required data. If you want to collect information from a table, specify "table". For parsing lists, use the “list” parameter.
- Number is the serial number of the element in the page code.
Read our article about using 16 Google Sheets features for SEO purposes. Everything is described here in great detail, with examples for each function.
VK.Barkov.net
Service for searching target audiences on VKontakte and Odnoklassniki. With its help, you can find intersections of people in several thematic groups, exclude blocked or deleted users from the final search results, track activity on the wall, filter people by first and last name, collect authors of photos, likes and reposts, and also search by marital status, administration communities and much more.
Peculiarities:
- There is no need to download it separately; the program runs in a separate browser tab.
- Wide selection of criteria for parsing.
- Working with large lists and volumes of data.
- Training videos on all functionality.
- There is a free plan for testing.
Autoposting scripts
In addition to online services, there are scripts for WordPress, Drupal and Joomla, which are installed directly into the site’s CMS.
I work with 1C-Bitrix, so I will only talk about this CMS.
At the time of publication of the article, there are 4 solutions for cross-posting / auto-posting for 1C-Bitrix with different functionality. Payment is one-time upon purchase (unlike payment for an online service, where the subscription is monthly). This is perhaps the only advantage of the script over the online service. Therefore, if you don’t want unnecessary complications, use the better service.
Please, in order not to make a mistake with your purchase, keep in mind that the modules listed below only work with 1C-Bitrix and to install them you must have an active Bitrix update period.
I strongly advise against using any of the modules. This is due to the fact that they do not work very well, to put it mildly. It can also be difficult for you to set them up yourself. Below, I have listed the main disadvantages of using cross-posting/auto-posting modules on a website.
What is better: a script or an external service?
I’ll tell you what, in my opinion, is better for cross-posting on a social network, using a module installed in your CMS or through an external online service.
Using modules (it doesn’t matter whether they are for Bitrix, for WP or for some other CMS) has a number of disadvantages:
- Efficiency of updates. Social networks are constantly updating, improving, and changing security rules. Sometimes updates cause auto-posting to “fall off” and stop working. In such cases, it is critical that an update be released as soon as possible for the module that you have installed in your CMS. In reality, this can take from several days to several weeks or months. And all this time, auto-posting from the site to any of the social networks will not work. With the use of external services for cross-posting, which I wrote about at the beginning of the article, this problem, of course, also exists, but it can be solved faster. For an online service, correct uploading to all declared social networks is vitally important - this is their main business. The same cannot be said about modules for CMS, whose creators do not prioritize supporting their own modules (for which they have already received money) (usually, their main business is developing custom websites).
- Speed of problem identification. Let's assume that uploading to Odnoklassniki has stopped working. How soon will the module developer become aware of this problem? Not until his clients write to him about it. The more users there are, the faster the problem is identified. An external service has a big advantage in this regard - it has more users.
- Problems on the client side. In the case of using a module for a CMS, it can easily be that uploading to a social network “fell off” only for you. For example, after some work on the site, changing hosting, updating the system. In this case, it is difficult for the site owner to identify the problem in order to solve it. The site owner does not understand whose technical support to write to, the support of a module that has stopped cross-posting, the support of Bitrix, or whether it was his own programmer who screwed up. Using an external service for publishing on a social network, it is very easy to determine whose side the problem is on. It’s enough to check whether uploading materials to RSS works on your website. If yes, then the problems are on the side of the external service, which means you can write to their technical support about this.
Whether the listed shortcomings are critical for you - decide for yourself. It’s also up to you to choose what to use – a script (module) for the CMS or an external online service.
To summarize what has been said , in my opinion, the question can be posed as follows: if you want a simple and reliable way to upload information from a site to a social network, use an external service, for example, one of the three listed above, and upload site materials to it via RSS. If you want to save 450 rubles/month. and are ready to sometimes have problems for the sake of this savings, then use the module for CMS .
Disadvantages of online crossposting services:
- The site needs the functionality of uploading to RSS; this will most likely require minor modifications (this is an additional cost for the programmer).
- To use the service, you will most likely have to pay 450 rubles per month or more, depending on your tariff plan.
I used to use modules too until I got tired of it. Then I switched to Novapress and for 4 years now I have had no problems. If you don't forget to pay, then everything works like clockwork. Since then I have been recommending this solution to all my clients.
TARGET HUNTER
Another online service that helps you find your target audience on VKontakte. More than 150 tools are available for search and analytics - you can automate them, and do other things at the same time as parsing. Thanks to analytics, you can find out the interests of your audience, analyze it and select the right key for it, and thus scale your advertising campaign. The service also allows you to track the maximum number of online users and reach more people.
Peculiarities:
- 24/7 support.
- There is a free plan.
- Automation of any processes when searching for target audience.
- Possibility to increase parsing speed by 5 times.
- More than 150 tools for finding target audience.
- Available in the browser, no need to download separately.
B2B.FileCloud – uploading a product catalog from an online store to the VKontakte social network.
Published: Nov 20, 2013
Recently, the popularity of social networks in the field of e-commerce has been growing rapidly. More and more entrepreneurs and online store owners are coming to the understanding that social networks not only provide additional traffic and communication with customers, but also sell very well if you know how to use them correctly. It’s no secret that we have already formed a certain layer of people for whom social networks are, in fact, synonymous with the Internet. These people spend hours on social networks, and use them not only for entertainment, but also to search for information and make purchases. To a greater extent, this, of course, applies to the most popular social network on the Runet, Vkontakte, which is used by both small private traders and large retailers. If the main goal of the VKontakte community is sales, then the first question that arises is how to organize a showcase of goods in the community. The task of uploading store products to the VKontakte group is a source of headaches for administrators. After all, if there are a lot of goods (let’s say, several thousand), then loading them all manually is very difficult and time-consuming. But downloading is half the battle, and you still need to regularly update information about price changes, stock availability, etc., which seems like an impossible task.
In this article, I want to talk about a service that permanently solves the problem of uploading goods from an online store to VKontakte albums. This service is called B2B.FileCloud and allows you to upload products from your store automatically. Moreover, the program regularly monitors any changes to product cards in the online store and promptly adds them to albums with VKontakte products. To implement these tasks, B2B.FileCloud uses a Yandex.Market file (YML file), which is an XML feed with your products. Today, most online stores have such YML files and actively use them in their work. If you don’t yet know what a YML file is and how to use it, I recommend reading this material https://help.yandex.ru/partnermarket/yml/about-yml.xml
Starting to work with B2B.FileCloud is very simple; it does not require any special technical skills from you and will not take much time. After a quick registration in the system, you will be redirected to the admin panel, where the first thing you need to do is connect your store (you can connect several stores). When connecting, you will need to enter the name of the store and a link to the YML file mentioned above.
The next step is to link the VKontakte community administrator account to the B2B.FileCloud service. To do this, go to the Accounts section in the top menu and click Add.
Please note that in order to link a VKontakte account, you need to be logged in to this account in the current browser. When you connect your account, a pop-up window will appear in which you will need to grant the application permission to post as an administrator. This is necessary so that B2B.FileCloud can upload photos to the albums of your VKontakte group.
After this, you need to return to the Stores section and click the “Customize” button opposite your store. On the page that opens, you can configure different modes for publishing photos in VKontakte albums.
The B2B.FileCloud service provides two publishing methods to choose from.
If you select the “Album” upload method, all photos from your YML file will be uploaded to one album of your community. You can assign which one in the drop-down list on the right.
If you choose the “Category” publishing method, the program itself will create a grid of albums based on the structure of your site and load photos of the corresponding category into each album. Below on the page you can choose what information about the product you want to upload to photo albums. There are seven fields, but please note that VKontakte has a limit on product descriptions of 255 characters, i.e. If your descriptions are quite large, they may not fit. Therefore, I recommend uploading no more than 3 of the most important fields, for example, “Name”, “Price” and “Link”.
In principle, these are the basic settings. Here you can also select the encoding of the downloaded yml file, if it differs from utf-8. Don’t forget to also select the required community administrator account id in “Social Network Account” and the group to which you want to upload photos from the store on this page.
After all the settings have been made, click “Save” and go to the “Schedule” section. Here, opposite your store, click “Edit” and set the time at which the program will monitor changes in the store and update your albums with VKontakte products.
Ready! You have added your store and now, at the time you specify, the product catalog will be uploaded from your online store to the VKontakte community. In the Reports section you can find out how the last time (based on the schedule) the unloading went (time and success).
As you can see, everything is quite simple! Now let's talk about tariffs. B2B.FileCloud is paid on a monthly subscription basis, and has several pricing plans, depending on the number of products you plan to upload.
This is very profitable, because in a month or two you will be able to evaluate whether unloading goods into the community is justified. However, I am sure that if you are actively involved in your VKontakte community, this service will not only pay for itself, but will seriously increase sales and income. If you still have doubts, there is also a free trial, with the ability to unload up to 100 product items.
So, if you sell goods through an online store and still do not use VKontakte to increase sales, I highly recommend that you start doing this now using B2B.FileCloud. You can learn more about this service at https://b2b.filecloud.me/.
If you need help with promotion on social networks, contact me and subscribe to blog updates on this topic.
Similar articles:
- The main trends in PPC development in 2021
- Promotion on TikTok: how a business can advertise its…
- Janky and Guggimon - toys “come to life” on the Internet
- 10 years challenge - simple fun or...
Share with friends
Pepper Ninja
An online parser for VKontakte that collects a live audience by age, gender, marital status, place of study or work, interests, activity and other parameters. The service does not take into account the pages of users who have not logged into the social network for more than 2 years, and also cuts off bots and offers. The parser collects all activists in communities who constantly like, repost and comment on posts. An auto-parser “Who is my client” is available, which searches for a similar audience by keyword, and with the help of a Live broadcast parser you can collect the IDs of those watching the broadcast on VKontakte every 60 seconds.
Peculiarities:
- There is an exchange of ready-made audiences for purchase.
- Parsing by music preferences.
- There is a free trial period.
- The ability to find an audience with similar interests to the same one.
- Search by several dozen features.
Why do we need parsers?
A parser is a program, service or script that collects data from specified web resources, analyzes it and outputs it in the required format.
With the help of parsers you can do many useful tasks:
- Prices . An urgent task for online stores. For example, with the help of parsing, you can regularly monitor competitors’ prices for the products that are sold by you. Or update prices on your website in accordance with the prices of the supplier (if he has his own website).
- Product items : names, articles, descriptions, characteristics and photos. For example, if your supplier has a website with a catalog, but does not have an upload for your store, you can parse all the necessary items rather than adding them manually. This saves time.
- Metadata : SEO specialists can parse the content of title tags, description tags and other metadata.
- Site analysis . This way you can quickly find pages with 404 errors, redirects, broken links, etc.
For reference . There is also gray parsing. This includes downloading content from competitors or entire sites. Or collecting contact information from aggregators and services like Yandex.Maps or 2GIS (for spam mailings and calls). But we will only talk about white parsing, because of which you will not have problems.
Where to get a parser for your tasks
There are several options:
- Optimal - if there is a programmer on staff (or even better - several programmers). Set a task, describe the requirements and receive a ready-made tool tailored specifically to your tasks. The tool can be further adjusted and improved if necessary.
- Use ready-made cloud parsers (there are both free and paid services).
- Desktop parsers are, as a rule, programs with powerful functionality and flexible settings. But almost all of them are paid.
- Order the development of a custom parser from companies specializing in development (this option is clearly not for those who want to save money).
The first option is not for everyone, and the last option may be too expensive.
As for ready-made solutions, there are quite a lot of them, and if you have not encountered scraping before, it can be difficult to choose. To simplify the choice, we have made a selection of the most popular and convenient parsers.
Is it legal to scrape data?
The legislation of the Russian Federation does not prohibit the collection of open information on the Internet. The right to freely seek and disseminate information in any legal way is enshrined in the fourth paragraph of Article 29 of the Constitution.
Let's say you need to scrape prices from a competitor's website. This information is publicly available; you can go to the site yourself, look and manually write down the price of each product. And with the help of parsing, you do essentially the same thing, only automatically.
But if you want to collect users’ personal data and use it for email campaigns or targeted advertising, this will already be illegal (this data is protected by the personal data law).
Segmento Target
A cloud service for collecting target audiences based on specified criteria, working with Vkontakte, Instagram and Odnoklassniki. With its help, you can collect active audiences in groups, commentators under posts, combine audiences, find community owners, and monitor new members of communities. The parser allows you to analyze your audience and filter out bots and inactive users. As a result of parsing, you receive a list of people who will be interested in the advertising you launch, and they will probably respond to it.
Peculiarities:
- There is a free trial period.
- Large selection of parsing tools.
- Collecting the database from any convenient device, no need to download the program.
- The ability to upload the collected audience directly to the VKontakte advertising account.
To set a picture as an album cover, you need to:
- naturally, draw this picture , for example, in Photoshop. If you are not fluent in graphics programs, then you better watch lesson 3 again, where we showed the basics of drawing in Photoshop. We recommend setting the image size to 640*420 pixels.
— upload the picture to the album for which it should be the cover
— go to the album and click the “Edit album” link at the top of the page on the right. Next, click “ Change cover ” and select the photo that you just prepared and uploaded:
Here's what happened:
All! Your album with a custom cover is ready! Repeat these steps for all your albums. We got it like this:
Note : the album “Photos from the Community Page” cannot have a cover uploaded because it is created automatically and contains the group avatars you have ever uploaded. If it bothers you, then you can simply move it to the end of the album list. We will tell you how to do this at the end of the lesson.
Cerebro Target
The application offers more than 100 ways to search for an audience. Among the capabilities of the site are collecting an audience by likes, comments and reposts, searching for the most interesting comments in any community, showing an active audience in the desired topic, searching for the most interesting posts, as well as searching for clients from competitors’ photo albums, collecting competitors who have recently joined competitors’ communities.
Peculiarities:
- There is a closed training group.
- You can directly upload the collected databases to your VK advertising account without saving it on your computer.
- Knowledge base for business promotion on VKontakte.
- More than 100 ways to find an audience.
- Run a task in the background.
How to upload a photo from a computer
The web version of the site for PC makes this process very fast and convenient. If you store photo materials on your computer or laptop that you want to show to friends or any social media users. network, then do the following:
- On your main profile page, go to the Photos section.
- Click on the Add photos button if you want them to appear in the general album of the page (Photos on your wall). You can also go to any of your existing albums and click the Add to them button so that the photo appears inside the selected album. You can also create a new album if you want to add new photos with a common theme. To do this, click the Create album button, then enter its name and configure access rights.
- With any option selected, a window will open for you to select a file to send to the site. Specify the path to the desired file and click Open. If there are a lot of photos, then just select each one.
- The selected materials will begin loading onto the site, after which you can add a description to each photo, if necessary.
Whether you want to post a photo on your wall, send a private message, or add a photo to a comment, there is a faster way. Just hold down the file from any folder on your PC with the left mouse button and drag it into the browser window with VK open to the line of typing a message, publishing a post or comment, and then release it. The photo will be uploaded immediately.
If you want someone's photos to appear on your page (funny pictures, photos in which you are, etc.), then there are the following methods for this.
Repost the material to your page
To do this you need:
- open the desired photo;
- click on the Share button in the form of a loudspeaker;
- select from the suggested options Friends and subscribers.
OKTarget
Parser of the target audience on VKontakte and Odnoklassniki, helping to collect a database of potential clients and increase sales. Suitable for arbitrage specialists, targetologists, entrepreneurs who want to improve the performance of advertising campaigns. The parser finds community members, significant other, birthday people and many other users, and filters the list by parameters. Analytics is available, in which you can choose a platform for advertising based on the interests of the audience, as well as monitoring new subscribers on whom you can target advertising.
Peculiarities:
- You can test it for free.
- More than 500 groups are available for monitoring.
- A task can be created from any mobile device.
- Work in the cloud around the clock.
- Large selection of parsing tools.
Types of parsers by area of application
For organizers of joint ventures (joint purchases)
There are specialized parsers for organizers of joint purchases (SPs). Manufacturers of goods (for example, clothing) install them on their websites. And anyone can use the parser directly on the website and download the entire assortment.
Why these parsers are convenient:
- intuitive interface;
- the ability to upload individual products, sections or the entire catalog;
- You can download data in a convenient format. For example, a large number of upload formats are available in the Cloud Parser, in addition to standard XLSX and CSV: an adapted price list for Tiu.ru, upload for Yandex.Market, etc.
Popular parsers for SP:
- SPparser.ru,
- Cloud parser,
- Turbo.Parser,
- PARSER.PLUS,
- Q-Parser.
Competitor price parsers
Tools for online stores that want to regularly monitor competitors' prices for similar products. With the help of such parsers, you can provide links to competitors’ resources, compare their prices with yours and adjust if necessary.
Here are three such tools:
- Marketparser
- XMLdatafeed
- ALL RIVAL.
Parsers for quickly filling sites
Such services collect product names, descriptions, prices, images and other data from donor sites. Then they are uploaded to a file or immediately uploaded to your website. This significantly speeds up the work of filling the site and saves a lot of time that you would spend on manual filling.
In such parsers, you can automatically add your own markup (for example, if you are parsing data from a supplier’s website with wholesale prices). You can also set up automatic collection or updating of data on a schedule.
Examples of such parsers:
- Catalogloader
- XMLdatafeed
- Diggernaut.
CleverTarget.ru
The service allows you to segment, analyze and forecast audience demand, launch geomarketing, and much more on one platform. You can search for an audience by certain criteria, track the authors of new comments and messages in groups on VKontakte, collect an audience without direct participation, i.e. work in parallel with parsing and receive separate reports by email. Unlike other services, here you do not need to pay for a month of work if you are actively using it for only a few days, because the payment is per second - you will only pay for the direct operation of the service.
Peculiarities:
- There is a free trial period.
- Analysis of demand and decline in customer interest.
- Reports on geopoints of interest are available.
- Search for an active target audience and low-competitive segments.
- Artificial intelligence for parsing.
Checklist for choosing a parser
A short checklist to help you choose the most suitable tool or service.
- Clearly define for what tasks you need a parser: analyzing SEO competitors or monitoring prices, collecting data to fill the catalog, picking up positions, etc.
- Determine how much data and in what form you need to receive.
- Determine how often you need to collect data: once or at a certain frequency (once a day/week/month).
- Choose several tools that suit your needs. Try demo versions. Find out if technical support is provided (it is advisable to even test it - ask a couple of questions and see how quickly you get an answer and how comprehensive it is).
- Choose the most suitable service in terms of price/quality ratio.
For large projects that require parsing large amounts of data and performing complex processing, it may be more profitable to develop your own parser for specific tasks.
For most projects, standard solutions will be sufficient (perhaps a free version of any of the parsers or a trial period may be enough for you).
Limbotarget.ru
The VKontakte audience parser allows you to search for an audience by friends, interests, active behavior in the community, birthdays and many other parameters. Ready results can also be filtered by specified criteria, for example, gender, age, place of residence. You can search for opinion leaders in communities, collect audiences from discussions and photo albums, and analyze the collected audience. The service is supported by any mobile devices.
Peculiarities:
- Audience filter directly in the table.
- Ability to scrape anywhere from a mobile device.
- Payment for a week or a month.
- Two week trial period.
- The results are sent by email.
Retarget.target-training.ru
It’s not as large a service as most of the ones on the list, but it also allows you to parse your audience. To get started, you need to log in to VKontakte, enter a word, phrases or a full phrase in a search engine, and start parsing the audience. As a result, you will find people who wrote the necessary words in the VKontakte group database. One of the big advantages is that the tool is free.
Uploading to Odnoklassniki albums
The functionality is similar to uploading to albums on VKontakte. Before uploading to Odnoklassniki (and other social networks), you can modify the following parameters:
- change the cost of goods (increase, multiply, decrease) - set the required markup;
- add/adjust product characteristics at your own discretion.
In addition, it is possible to manually mark specific products that need to be included or excluded from the upload.
Instructions for uploading to Odnoklassniki albums
Publer
The service has a wide functionality and is aimed not only at parsing, but also at analyzing competitors’ advertising, selecting teasers, searching for the best products and launching advertising on a social network to the desired audience. As a parsing tool, you can search for intersections between groups, that is, you can analyze several groups of competitors and find the audience that is there. An analysis of user involvement in the life of the community on VKontakte is also available.
Peculiarities:
- There is a free plan.
- Comprehensive analysis of communities with graphs and comparative tables.
- Search for different teasers.
- Search for effective advertising of competitors.
- Export the results to Excel.
Uploading to VKontakte albums
In addition to the “Products” section, you can export products to community or profile albums. Convenient features:
- create new albums directly through Q-Parser;
- upload the entire catalog or only products that are in stock/out of stock;
- uploading each product photo as a separate item in the album;
- add a link to the store directly in the description (at the end or at the beginning).
A tool for active and interested entrepreneurs: minimum time and action - maximum result
. Do you use other social networks? Read on.
Instructions for uploading to VKontakte albums
Parsing prices
Service | Prices |
VK.Barkov.net | 249 rubles per day or 699 rubles per month. |
TARGET HUNTER | From 18 rubles per day when paying for a year (we have a promotional code for 2 free days + 1 month when purchasing more than a month). |
Pepper Ninja | 3 days free, then from 490 rubles per month (we have a promotional code for a free month when purchasing more than a month). |
Segmento Target | Depends on the social network: VKontakte - 699 rubles per month, Instagram - 799 rubles per month. Other and additional options are available. |
Cerebro Target | From 750 rubles per day or from 1200 rubles per month. |
OKTarget | Depends on the functions and social network: parsing - from 318 rubles per month (if paid for a year). |
CleverTarget | Parsing from 0.3 rubles per minute. |
Limbotarget.ru | From 300 rubles per month. |
Publer | 449 rubles per day or from 2 thousand rubles per month (there is a promotional code for a 10% discount). |
Parsers for SEO specialists
A separate category of parsers are narrow or multifunctional programs created specifically to solve the problems of SEO specialists. Such parsers are designed to simplify the complex analysis of website optimization. With their help you can:
- analyze the contents of robots.txt and sitemap.xml;
- check for the presence of title and description on site pages, analyze their length, collect headings of all levels (h1-h6);
- check page response codes;
- collect and visualize the site structure;
- check for image descriptions (alt attribute);
- analyze internal linking and external links;
- find broken links;
- and much more.
Let's go through several popular parsers and consider their main features and functionality.
Meta tags and headers parser PromoPult
Cost: first 500 requests are free. The cost of subsequent requests depends on the quantity: up to 1000 - 0.04 rubles/request; from 10000 - 0.01 rub.
Possibilities
Using a meta tag and title parser, you can collect h1-h6 headers, as well as the contents of title, description and keywords tags from your own or other sites.
The tool will come in handy when optimizing your website. With its help you can detect:
- pages with empty meta tags;
- uninformative or misspelled headers;
- duplicate meta tags, etc.
The parser is also useful when analyzing SEO competitors. You can analyze what keywords competitors optimize the pages of their sites for, what they write in the title and description, and how they form headlines.
The service runs in the cloud. To get started, you need to add a list of URLs and indicate what data needs to be parsed. You can add a URL manually, upload an XLSX table with a list of page addresses, or insert a link to a sitemap (sitemap.xml).
Working with the tool is described in detail in the article “How to collect meta tags and headings from any site in one click?”
The meta tag and title parser is not the only parsing tool in the PromoPult system. In the SEO module of the system, you can freely parse keywords for which the site added to the system ranks in the TOP 50 in Yandex/Google.
Here, on the “Words of your competitors” tab, you can download competitors’ keywords (up to 10 URLs at a time).
Read more about working with key parsing in the PromoPult SEO module here.
Netpeak Spider
Cost: from $19 per month, there is a 14-day trial period.
Parser for complex website analysis. With Netpeak Spider you can:
- conduct a technical audit of the site (detect broken links, check page response codes, find duplicates, etc.). The parser allows you to find more than 80 key internal optimization errors;
- analyze basic SEO parameters (robots.txt file, analyze site structure, check redirects);
- parse data from websites using regular expressions, XPath queries and other methods;
- Netpeak Spider can also import data from Google Analytics, Yandex.Metrica and Google Search Console.
Screaming Frog SEO Spider
Cost: annual license - £149, free version available.
A multifunctional tool for SEO specialists, suitable for solving almost any SEO problems:
- search for broken links, errors and redirects;
- analysis of page meta tags;
- search for duplicate pages;
- generating sitemap.xml files;
- visualization of the site structure;
- and much more.
The free version has limited functionality and also has limits on the number of URLs for parsing (you can parse only 500 URLs). The paid version does not have such limits, and more features are available. For example, you can parse the contents of any page elements (prices, descriptions, etc.).
We wrote in detail about how to use Screaming Frog in the article “Parsing any website for dummies: not a line of code.”
ComparseR
Cost: 2000 rubles for 1 license. There is a demo version with limitations.
Another desktop parser. With it you can:
- analyze technical errors on the site (404 errors, duplicate titles, internal redirects, pages blocked from indexing, etc.);
- find out which pages the search robot sees when scanning the site;
- The main feature of ComparseR is the parsing of Yandex and Google results, which allows you to find out which pages are in the index and which are not included in it.
Website analysis from PR-CY
Cost: paid service, minimum tariff - 990 rubles per month. There is a 7-day trial version with full access to functionality.
Online service for SEO analysis of websites. The service analyzes the site using a detailed list of parameters (70+ items) and generates a report indicating:
- detected errors;
- error correction options;
- SEO checklist and tips for improving website optimization.
Website analysis from SE Ranking
Cost: paid cloud service. There are two payment models available: monthly subscription or pay per review.
The minimum tariff is $7 per month (if you pay for an annual subscription).
Possibilities:
- scanning all website pages;
- analysis of technical errors (redirect settings, correctness of canonical and hreflang tags, checking duplicates, etc.);
- searching for pages without title and description meta tags, identifying pages with too long tags;
- checking page loading speed;
- image analysis (searching for broken images, checking for filled alt attributes, searching for “heavy” images that slow down page loading);
- analysis of internal links.
Xenu's Link Sleuth
Cost: free.
Desktop parser for Windows. Used to parse all URLs that are on the site:
- links to external resources;
- internal links (linking);
- links to images, scripts and other internal resources.
Often used to find broken links on a website.
A-Parser
Cost: paid program with lifetime license. The minimum tariff plan is $119, the maximum is $279. There is a demo version.
A multifunctional SEO combine that combines 70+ different parsers tailored for various tasks:
- keyword parsing;
- parsing data from Yandex and Google maps;
- monitoring website positions in search engines;
- content parsing (text, images, videos), etc.
In addition to a set of ready-made tools, you can create your own parser using regular expressions, the XPath query language or Javascript. API access available.