portfolio2.jpg

PORTFOLIO

Curious about what we have accomplished? Take a look!

web-scraping-1.png

Web data extraction

TDCM is an extended dev team that is not afraid of challenges. Among all of the solutions we have delivered so far, web-scraping has a special place in our hearts. Every project we have implemented from within that spectrum brought our customers the ease of controlling their businesses and outcomes. Moreover, each of them started with very custom requirements, which we were able to meet. Whether it’s several records per month or millions per week, data health always plays a fundamental role. We always start with a discussion stage in which we gather and analyze needs and expectations. As soon as the goals are clear, the design phase begins, where every decision is carefully weighed. After that, the implementation is just a formality. An essential factor of every successful project, though, is communication. Needs might change over time, new issues are likely to arise as time goes by and the key is to keep up with them. So, how do we manage that? To bring a structure to life is one thing, but to maintain its operability is where the fun part begins. To assure data quality, we utilized custom server applications based on Node.js that would validate, process and shape the scraped information to the desired format, then eventually deliver it to the agreed-upon destination. We ensure the continuous functioning of every workflow with scheduled automatic test suites that notify our team about any problem or malfunction. This enables us to provide quick and accurate reactions in the event of failure, and we are proud to say that it has never taken more than 48 hours to get our systems back up and running at full speed. Continuous monitoring of the data sources is established, which turns out to be crucial in preventing most of the issues. All of those combined with swift communication results in seamless and smooth experiences for our clients. Keeping track of the reviews gets out of hand? Bogged down with repetitive operations? Monitoring the market overwhelms you? The solution is within your reach. Contact us!

Technologies:

JavaScript, TypeScript Node.js, Chai, Heroku, AWS, Phyton

Year:

2018/20

Share: