You can check header information of a web page as search engines check header before crowling the webpage. Check HTTP Header of webpage Webmaster Tool.
webtools.live2support.com/header.php
-
Get Site Info
The Microsoft Win32 Internet (WinInet) API provides stand-alone applications with easy access to standard Internet protocols such as Gopher, FTP, and HTTP. The WinInet API abstracts the protocols into a high- level interface that is familia...