If you are having trouble getting pages or feel that the number of pages is less than expected, please try the following.
1. Add a domain to be crawled
AeyeScan only crawls pre-approved domains, so in the following cases, the domain may not be registered enough.
- Use of an external site (e.g., Amazon Cognito) for authentication
- The GUI and API are configured with different FQDNs
(https://www.example.com and https://api.example.com )
Register the required domain name in one of the following ways.
a）Add manually (before automatic crawl)
How do I set up authentication for a different domain?
b）Add using remote browser (before automatic crawl)
Domain settings are missing(Cannot crawl the Page as expected)
c）Add based on candidates found by AeyeScan (during / after automatic crawl)
I checked the crawl results and some pages are not crawled. Please let me know how to deal with this.
2. Review crawl/scan target settings
If you have set a path to be excluded in Scan List > New Scan > Scan for Crawl/Scan Target Settings, it may prevent the acquisition of crawl targets.
Please reduce the exclusion settings to the minimum necessary and crawl again.
3. Use manual crawl(remote browser)
If the automatic crawl cannot crawl the login transition or the post-login page, manual patrolling for the login process(remote browser) may solve the problem.
In this case, it is possible to use automatic crawl(combining manual and automatic crawls) on the page after the login process.
See "Troubleshooting" below for details.
My login fails in the automatic crawl.
4. Check for errors in form submission input
In some cases, the form entered by AeyeScan may have resulted in an error and you may not have been
able to move on to the next page.
Please refer to the "FAQ" below to confirm the nature of the error.
Is there a way to check the page on which the form submission was filled out in error?
Please refer to the "FAQ" below for common errors and their solutions.
If the same value can only be registered once, is there a way to change the input value and perform a scan?
5. Specify the waiting time for drawing (page)
If some screens take a long time to page, the automatic navigation of subsequent screens may fail.
Refer to "Troubleshooting" below to specify the drawing wait time (Wait time) individually.
After crawling, no results are displayed while loading.
6. Change settings related to AeyeScan's automatic crawl
Depending on the behavior and implementation of the target system, the automatic crawl may fail.
If any of the following scenes are present, please change the contents of Scan List > New Scan > Scan Basic Options.
※Editing is possible only when the status of the corresponding scan is "Wait" or "Crawl Error" on the "Scan List" screen. For any other status, please recreate the scan.
|
Item Name
|
Value
|
Item Description
|
Scenes where setting changes are effective
|
| Auto Window Control |
Enabled ✓ Disabled |
Sets whether automatic control is performed (Enabled) or not (Disabled) when opening a new tab (window) on a site with multiple tabs (windows) open. |
This is useful when the transition to open a new tab (window) cannot be reproduced by crawling, and when neither auto-crawling nor remote browsers can be used for crawling. |
| Shortcut Access when Auto Crawling |
Enabled ✓ Disabled |
When accessing a screen that has already been registered in the screen transition diagram again, this setting determines whether some transitions are omitted (Enabled) or not (Disabled). |
This setting is effective when a site that checks the order of screen transitions cannot be crawled, such as sites where the "Back" and "Reload" buttons on the browser cannot be used. Note that this setting change will not solve the problem if the remote browser is also unable to navigate the site. |
| "a" tag Operation |
Auto Identify ✓ Click Jump to the Linked Target |
The operation for the "a" tag can be either a click operation or a direct jump to the URL set in the href. | This is useful when screen transitions by the a tag cannot be patrolled. |
| XHR Similar Pages Determination |
Enabled ✓ Disabled |
Controls whether (or not) similarity judgments are made based on the contents of XHRs when multiple XHRs are sent. |
This is useful when there are pages that cannot be crawled due to excessive similarity judgments made by the automatic crawl. Note that this setting change does not resolve the case where the system cannot be crawled even after "click the specified link/button and patrol again" is performed. |
| Shadow DOM support for manual crawl |
Enabled |
If manual crawling is performed, this setting determines whether crawling is performed (enabled) or not (disabled) in response to the shadow DOM. |
If you cannot crawl a site that uses the Shadow DOM, you may be able to crawl it by enabling this option and performing a manual crawl with a remote browser. |
※ Values marked with "✓" are default values
7. Edit recorded operations in the remote browser
Depending on the behavior and implementation of the target system, manual traversal by remote browsers may fail.
For example, in cases where a transition to a URL link that does not exist in the displayed screen is required, In some cases, it may be possible to use the remote browser's operation editing functionality to patrol and scan.