Techno m’lounge – Where technology meets human senses.

External public social networking services, such as Facebook, MySpace, LinkedIn, and Friendster, can be valuable sales, marketing, and support tools. These services comprise extensive networks of users who are self-organized into groups and communities. Users establish connections directly with other users to form a personal friends network. Users also join groups and communities that are organized around attributes such as products, lifestyles, entertainment, institutions, politics, and geographic locations.

The key difference between social networks and more traditional online communities is the friend-of-a-friend (FOAF) trust model that exists in social networks. Users maintain direct connections to their friends, but they also have some level of access to the direct connections their friends maintain to other people. The FOAF model enables users to interact with network users to whom they are not otherwise directly connected. Users can establish different rules of engagement for different types of connections in their network; the closer the connection to a user in terms of degrees of separation, the more trusted that user is. For example, privacy settings can be made more stringent for a FOAF than privacy settings for a directly connected friend.

Just imagine , if 100s of social users keep telling their friends about your fantastic new website… what a killer volume of traffic will it generate for you.

I write the tools to achieve the same. My bots can be a real automated traffic engine for your new website.

Popularity: 23% [?]

The huge status of the Search Engine Giant – Google has always  led me to explore the technologies it uses to power itself. This has led me to explore the all new world of Web Crawlers ,  Indexers,  Full Text Search,  Map Reduce File Systems like Hadoop and lots of more techy stuff.

The first thing I wanted to start with was writing a web crawler , just for kinda fun.

I wrote my first web crawler in first year of my college in Visual Basic. It was a small crap with a simple web browser control in VB embedded in a form and simple html parser to parse text.  But I know how much excited I was to write it.

Coming off these years my understanding of Web Crawlers have matured a lot and I have been able to spun complex crawlers from scratch or modify state of art crawlers like Nutch and Bixo for my needs.

Most of the Crawlers or Scrappers I write are written in C# or Java using Advanced Design Patterns and can be robust enough to crawl millions of web pages within a week’s time and can run across several clusters of computers in Master Slave Mode fetching in storing data in simple databases to complex Map Reduce file systems.

Over a series of articles I will be explaining how to write a basic to very complex web crawler using effective design patterns.

Check out the articles as series. These will include my work with some common crawling engines like Bixo and Search Engines like Nutch.

1. What’s  a web crawler or Web Scraper?

2. How to make your search engine?

3. Is it possible to take on Google, Yes but how? Vertical search …? Localized search ? Nah…

4. What is indexing, how does an indexer work, rambling on Apache Lucene project.

5. Whats a BOT?  How does it automate stuff we do daily. Will spam really rule in the internet one day?

and many more ….

Popularity: 14% [?]