WEBCRAWL_RECURSEFLAGS Enumerated Type

---

Contains the flags for the default link crawling agent included with the Information Delivery API.

Syntax

typedef enum WEBCRAWL_RECURSEFLAGS {
    WEBCRAWL_DONT_MAKE_STICKY = 0x0001,
    WEBCRAWL_GET_IMAGES       = 0x0002,
    WEBCRAWL_GET_VIDEOS       = 0x0004,
    WEBCRAWL_GET_BGSOUNDS     = 0x0008,
    WEBCRAWL_GET_CONTROLS     = 0x0010,
    WEBCRAWL_LINKS_ELSEWHERE  = 0x0020,
    WEBCRAWL_IGNORE_ROBOTSTXT = 0x0080
} WEBCRAWL_RECURSEFLAGS;

Constants

WEBCRAWL_DONT_MAKE_STICKY

Instructs the agent to cache the downloaded resources normally. If this value is not set, the agent makes the entries "sticky," which prevents them from being removed during a normal cleanup operation.

WEBCRAWL_GET_IMAGES

Instructs the agent to download any images associated with the resource.

WEBCRAWL_GET_VIDEOS

Instructs the agent to download any videos associated with the resource.

WEBCRAWL_GET_BGSOUNDS

Instructs the agent to download any background sounds associated with the resource.

WEBCRAWL_GET_CONTROLS

Instructs the agent to download any controls associated with the resource.

WEBCRAWL_LINKS_ELSEWHERE

Instructs the agent to follow links that go to sites outside of the site where the resource resides.

WEBCRAWL_IGNORE_ROBOTSTXT

Instructs the agent to ignore any robot scripts.

Enumerated Type Information

Windows NT	Use version 4.0
Windows	Use Windows 95 and later
Header	Declared in Subsmgr.h
Minimum availability	Internet Explorer 4.0