In the Web engineering process, Web-based system testing, validation and acceptance is an important and challenging task.Web-based system testing different from traditional software testing, it will not only need to check and verify operation in accordance with design requirements, but also to test the systems in different end user's browser display is appropriate.Important, but also from the perspective of the end-user security and usability testing.However, Internet and Web media, the unpredictability of the test Web-based system difficult.Therefore, we must test and evaluation of complex Web-based system for new methods and technologies.
This article is divided into six parts web test:
1. Functional testing
2. Performance testing (including load / stress testing)
3. User Interface Testing
4. Compatibility Test
5. Safety test
6. Interface Test
The purpose of this paper is to cover all aspects of web testing, not on a topic in depth description.
Functional Test 1
1.1 Link Test
Web application system link is one of the main features, it is to switch between pages and guide the user to pages that do not know the address of the principal means.Link test can be divided into three areas.First, test all links are instructed, as indeed linked to the linked page; Secondly, test the linked page exists; Finally, to ensure that Web applications do not have isolated the page, the so-called isolation of the page is no link to the pageonly know the correct URL address to access.
Can automatically link test, now there are many tools can be used.Link test must be done in the integration testing phase, that is, in the entire Web application development after the completion of all the pages link to test.
Take measures to: The software automatically detects the web link to the.
Recommended software:
Xenu Link Sleuth free installation software free green
HTML Link Validator share (30 day trial)
1.2 Form Test
When users submit information through a form, when all you want the form to work properly.
If you use a form to register online, make sure the submit button to work properly, when the registration is completed successfully registered should return the message.If you use forms to collect information distribution should ensure that the program can process the data correctly, customers can allow customers to receive the final package.To test these programs, you need to verify that the server can save the data correctly, but running in the background of the program can correctly interpret and use information.
When a user uses a form for user registration, login, information submitted to other operations, we need to test the integrity of the commit operation, to verify the information submitted to the server is correct.For example: a user fills out the birth date and occupation is appropriate, fill in the respective provinces and cities where the matches and so on.If you use the default values, but also to test the correctness of the default values.If the form can only accept certain values specified, then have to be tested.For example: only accept certain characters, these characters can skip the test to see whether the system will complain.
1.3 Data Validation
If business rules are based on the need for user input validation, need to ensure that these calibration functions work properly.For example, the province can field an effective check list.In this case, the need to verify that the correct call list and the program complete the list (for example, list the value of adding a test to determine the system can accept the test value).
In the test form, the form of the test and the test may be some duplication.
1.2 and 1.3 measures: the first complete version of a manual inspection, while the formation of WinRunner (QTP) script; regression testing, and upgrade depends mainly on WinRunner (QTP) automated playback test.
1.4 cookies test
Cookies are usually used to store user information and user operation of the system in an application, when a user visits Cookies when a certain application, Web server sends information about users to the information Cookies are stored on the client computer, this can be used to create dynamic and customized landing pages, or store information.
If the Web application uses the Cookies, Cookies must check whether the work properly.Test whether the work can include Cookies, whether the scheduled time to save, what to refresh on the impact of Cookies.If the cookies stored in the registration information, please confirm that the cookie to work properly and that the information has been encrypted.If you use a cookie to count the number of accumulated need to verify that the correct number.
Measures:
1 with black box testing: The test method mentioned above
2 View cookies of the software used (initial idea)
The software can choose
IECookiesView v1.50
Cookies Manager v1.1
1.5 Database Test
In the Web application technologies, play an important role in the database, the database management system for the Web application, operation, query and implement user requests for data storage and other available space.In Web applications, the most common type of database is a relational database, you can use SQL to process the information.
In the use of the Web database application system, under normal circumstances, two errors may occur, namely, data consistency errors and output errors.Data consistency error was mainly due to the user submits the form, caused by incorrect information, and output error is mainly due to network speed or programming caused problems for both cases can be tested separately.
Measures: No better test methods
To 1.2 and 1.3 consider the combination of tests
1.6 application-specific functional requirements
Most importantly, testers need to application-specific functional requirements for validation.All users may try to carry out operations: order, change orders, cancel orders, checking order status, change in delivery information before sending the goods, online payment and so on.This is the reason why the use of the website because the user must be able to confirm the site as amazing as advertised.
Measures: a deep understanding of the requirements documentation
1.7 Design of Language Testing
Web design language differences can cause the client or server side serious problems, such as the use which version of HTML and so on.When developed in a distributed environment, developers are not together, this question is particularly important.In addition to HTML version of the problem, various scripting languages such as Java, JavaScript, ActiveX, VBScript or Perl, also have to be validated.
No method of testing, can refer to the updated information that discussion groups
2 Performance Test
2.1 Connection speed test
Web application users to connect to the Internet the way under the speed of change, they may be dial-up or broadband Internet access.When downloading a program, the user can wait a long time, but if not just visit a page like this.If the Web system response time is too long (eg more than 5 seconds), the user will not have the patience to wait for and leave.
In addition, some pages are out of limits, if the response is too slow, the user may have not had time to browse the content, you need to re-landed.Moreover, the connection speed is too slow, and may cause data loss, allowing users to get the real page.
Load Testing 2.2
Web load test is to measure the system performance of a given load level, the system needs to ensure the Web can work within.Load level can be a moment while the number of users access the Web system can also be a number of online data processing.For example: Web applications can allow the number of simultaneous users online? If you exceed this amount, what will the phenomenon? Web applications can handle the large number of users on the same page request?
2.3 stress test
Load testing Web systems should be arranged after release, in the actual network environment for testing.Because an internal staff, especially the project team is always limited, and a Web system can deal with the number of requests will far exceed this limit, therefore, only on the Internet, accept the load test, the result is correctcredible.
Stress testing is the actual destruction of a Web application system, a reflection of the test system.Stress testing is to test the system constraints and fault resilience, that is, test the Web application system will not collapse, in what circumstances would collapse.Hackers often provide incorrect data load until the Web application system crash, then when the system restarts to obtain access.
Stress test areas including forms, landing pages, and other information transmission.
Load / stress testing should be concerned about what
Tests need to verify that the system can respond at the same time a large number of users, the users can transfer large amounts of data, response time, the system can run a long time.Accessibility to users is extremely important.If you get "system busy" message, they may give up and turn to competitors.System detected not only enable users to access the site properly, in many cases, there might be hackers trying to send a large amount of data packets to attack the server.For security reasons, the test should be aware of when the system is overloaded, what measures are needed, rather than simply to improve system performance.
Instant access to the peak
If your site used to publish the results of the lottery draw, the best the system after the announcement of the winning numbers in the period of time to respond to millions of requests.Load testing tools to simulate X users also access the test site.
Transmission of large amounts of data for each user
Most users online bookstore 1-5 may only order the book, but the University Bookstore Order 5000 may be described in textbooks on psychology? Or a grandmother of 50 grandchildren for her Christmas gifts (of course, each child has their own e-mailaddress) the system can handle a large number of individual user data?
The use of long
If the site used to process orders for flowers, then at least want it to her mother the week before the holiday can continue running.If the site provides web-based email service, it is best to continue to run the point a few months or even years.May need to use automated testing tools to complete this type of test, because it is difficult to complete these tests by hand.Organization you can imagine 100 people at the same time click on a site.However, it also organized 100,000 people.Typically, the test tools used in the second, when the benefits it creates, is enough to cover costs.Moreover, the test tools installation is complete, re-used, as long as a few clicks.
Measures: use of test tools WAS, ACT test help
3 user interface test
Navigation Test 3.1
Navigation describes the operation of the user in the way of a page in between the different user interface controls such as buttons, dialog boxes, lists, and windows; or between pages in a different connection.By considering the following questions, you can decide whether the system is an easy-to-navigate Web application: the navigation is intuitive? Web is a major part of the system can access the home page? Web systems need to site map, search engine or other navigation help?
Put too much on one page of information often played with the expected opposite effect.Web application users tend to target drive, quickly scanning a Web application to see if there is information that meets your needs, if not, will soon leave.Few users are willing to take the time to become familiar with the structure of Web applications, therefore, Web application system to help navigate accurately as possible.
Another important aspect of the navigation application system Web page structure, navigation, menus, connections are the same style.Ensure that users intuitively know which Web applications are still content, content in what place.
Once the Web application level decisions, we must proceed with a test user navigation features to allow end users to participate in this test, the effect will be more apparent.
3.2 Graphics Test
In the Web application, the appropriate images and animations can not only play the role of advertising, but also play the function of beautifying the page.A Web application may include graphic images, animations, borders, colors, fonts, backgrounds, buttons and so on.Graphic content of the test are:
(1) To ensure the use of clear graphics, images or animations do not stack together at random, in order to save transmission time.Web application system to try a small image size, and to be able to clear something, are generally linked to a specific page.
(2) verify that all pages are the same font style.
(3) The background color should the font color and foreground color matched.
(4) image size and quality is also a very important factor, generally use the JPG or GIF compression, the best image size can be reduced to 30k the following
(5) Finally, the need to verify that the text wraps correctly.If the caption pointing to the right of the picture, it should ensure that the image appears on the right.Do not use the picture leaving the window and paragraph alignment, or appears isolated eccentric line.
In general, using little or as much as possible not to use the background is a good choice.If you want to use the background, it is best to use a single color, and the navigation bar on the page with the left.In addition, the patterns and images may transfer the user's attention.
3.3 Content Test
Content of the test used to test the Web application to provide information is correct, accuracy and relevance.
Correctness of the information refers to information that is reliable, or misinformation.For example, in the list of commodity prices, the price of error may cause financial problems and even lead to legal disputes; the accuracy of information is whether there are grammar or spelling errors.This test usually use some word processing software, for example using Microsoft Word's "spelling and grammar checking" function; relevance of information is whether the current page can be found browsing information with information relevant to the current list or import,Web site is general in the so-called "articles list."
For developers, it may be functional and fishes to describe this feature.We sit together and discuss some new features, and then began to develop, in the development time, developers may not pay attention to written expression, they may just add text to align page.Unfortunately, such products may be out of a serious misunderstanding.Therefore, testers and content of the public relations department checked the text with the expression is appropriate.Otherwise, the company might run into trouble, it may lead to legal problems.Testing should ensure that the site looks more professional.Excessive use of bold, large font and underlined may make the user feel uncomfortable.Usability testing for user, it is best call graphic design experts to assess the site.You may not want to see an article full of bold, so I believe you also want your site more professional.Finally, the need to determine whether the list of links to related sites.Many sites want users to send messages to a specific address, or from a site to download the browser.However, if the user can not click on these addresses, they may feel very confused.
3.4 Form Test
Need to verify that the form is set correctly.Users need to scroll right to see product prices? The price on the left, while the product details on the right is more effective? The width of each column is wide enough, tables are folded in the text is the line? WhetherThere are too many for the content of a cell, and the entire line stretch?
3.5 overall interface test
Overall the interface is the Web page design application, is to give users a sense of wholeness.For example: When a user browses Web application system is comfortable, whether instinctively know where to find information? The entire Web application system design consistent?
Interface on the overall testing process, the end user is actually a process of investigation.Web applications typically take on the home page to make a questionnaire form to get the end-user feedback.
The user interface for all test, the need for external staff (and Web application development not linked to or contact a small staff) involvement, it is better end-user involvement.
Measures: manual testing, preferably with external personnel involved in personnel
4 Compatibility Test
4.1 Test Platform
Market, there are many different types of operating systems, the most common are Windows, Unix, Macintosh, Linux and so on.Web application system which the end user how to use the operating system, depending on the user's system configuration.In this way, compatibility problems may occur, with an application may in some operating systems it works, but in another operating system may fail.
Therefore, before the release of the Web system, you need a variety of operating systems on the Web system compatibility testing.
4.2 Browser Test
Web browser is the core of the client components from different vendors browser Java,, JavaScript, ActiveX, plug-ins or different specifications have different support HTML.For example, ActiveX is a Microsoft product, is designed for the Internet Explorer, JavaScript is a Netscape product, Java is Sun's product and so on.In addition, the framework and the hierarchy of styles in different browsers have different display, or even not at all.Different browsers and Java security settings are not the same.
A browser compatibility testing is to create a compatibility matrix.In this matrix, test different vendors and different versions of the browser settings of certain components and adaptability.
4.3 Resolution test
Page layout in 640x400, 600x800 or 1024x768 display resolution mode is normal? Fonts are too small to view? Or too large? Text and images are aligned?
4.4 Modem / connection speed
Is there such a situation, users 28.8 modem takes 10 minutes to download a page, but when testers used in testing is the T1 line? Users download articles or presentations, it may be waiting a long time, but notpatiently waiting for page to appear.Finally, the need to make sure pictures are not too large.
4.5 Printer
Users may print out the page.Therefore, when the network is also designed to take into account printing problems, pay attention to save paper and ink.Many users prefer to read instead of staring at the screen, so need to verify that pages print properly.Sometimes the screen image and text alignment may print out something different.Testers need to verify at least print the order confirmation page is normal.
4.6 Combined test
Finally, the need for combined testing.600x800 resolution may be good in the MAC machine, but IBM compatible computers is very ugly.In the IBM machine can be displayed using Netscape, but can not use Lynx to browse.If it is for internal use web site, the test may be easier.If you use a designated type of browser, then simply to test the browser.If all people are using T1 lines, may not need to download the test applied.(But note that there may be employees dial into the system from home) some internal applications, system requirements development department in the declaration may not support some of the system supports only some of those who have set up the system.However, the ideal situation is that the system can run on all machines, so as not to restrict future development and change.
Measures: the actual situation by taking equivalent method, are listed in the compatibility matrix
5 safety test
Even if the site does not accept credit card payments, security is very important.Web site user information collected in-house use only.If hackers disclose user information, the customer during the transaction, there would be no sense of security.
5.1 Directory Settings
Web security is the first step in the right settings directory.There should be index.html for each directory or main.html page, so it will not display all the contents of the directory.I serve a company does not enforce this rule.I selected a picture, click the right mouse button, find the picture where the path "... com / objects / images".Then in the browser address bar manually enter the path and found a list of all the pictures of the site.This may not matter.I go to the next level directory "... com / objects", click the jackpot.There are many in the directory information, which caught my attention is out of date page.The company to change prices every month, and save the page expired.I look a bit these records can estimate their profit margins and their fight for a contract, there is much to the price cut.If a customer view this information prior to negotiations, they certainly have the upper hand at the negotiating table.
5.2 SSL
Many sites use SSL for secure transmission.You know you into a SSL site is because the browser warning message appears, and in the address bar of HTTP into HTTPS.If the development department uses SSL, testers need to determine if there are appropriate alternative to the page (for 3.0, the following version of the browser, these browsers do not support SSL. When a user enters or leaves the secure site, when prompted to make sure there is a correspondinginformation. whether there is connection time limit? more than what happens after the time limit?
5.3 Login
Some sites require users to log on to verify their identity.This is convenient for users, they do not enter personal information each time.You need to validate the system to prevent illegal user name / password login, and be able to valid login.Are there limits the number of users log on? Whether to restrict login from certain IP address? If the number of login failures is 3, in your third time to enter the correct login user name and password validation through it? Rules limit you choose a password? Can not login directly to view a page?
Web applications have restrictions on overtime, that is, the user after landing in a certain period of time (eg 15 minutes) did not click any page, and the need to re-login to work properly.
5.4 Log Files
In the background, should pay attention to the authentication server logs working.Logs of all transactions recorded? Is an attempt to record the registration failed? Whether the use of stolen credit card records? Whether the completion of each transaction to save time? Record IP address? Record the user name?
5.5 Scripting Language
Scripting language is a common security risks.The details of each language is different.Some scripts allow access to the root directory.Others only allow access to the mail server, but experienced hackers can be the server user name and password sent to them yourself.Use the site to find out what scripting language, and to study the language of the defects.Also need to test has not been authorized, it can not be placed on the server side script and editing problems.The best way is to subscribe to a scripting language used to discuss site security news groups.
6 Interface Test
In many cases, web sites are not isolated.Web site may communicate with the external server, request data, validation data, or submit your order.
6.1 Server Interface
The first interface is a need to test the browser and the server's interface.Testers to commit the transaction, and then view the server logs, and verify that the browser on the server just to see happen.Testers can also query the database to confirm the transaction data is correctly saved.
This test can be attributed to the functional form test test test and data verification
6.2 External Interface
Some web systems have an external interface.For example, the online store may want to verify credit card data in real time to reduce the incidence of fraud.Test, to use the web interface to send some business data, respectively, a valid credit card, valid credit cards and stolen credit card to verify.If the store only Visa card and Mastercard cards, you can try to use Discover card data.(A simple client-side script to the code before the transaction is committed to identify, for example, 3 for American Express, 4, said Visa, 5, said Mastercard, 6 on behalf of Discover.) Typically, testers need to verify that the software can handle all the possible return of an external servernews.
This situation may be reflected in the remote meter reading to
6.3 Error Handling
Most easily overlooked where the tester is an interface error handling.Usually we try to verify that the system can handle all errors, but can not predict all possible system errors.Attempt to interrupt the transaction process and see what happens? Order is complete? Try to interrupt the user to the server's network connection.Try to break web server to the credit card verification server.In these cases, the system can properly handle these errors? Whether to charge the credit card? If the user interrupts the transaction, the order has been saved and the user does not return to the site identified, the need for telephone users on behalf of the customer order confirmation.
Measures: in understanding the basis of need, give full play to the imagination, as a more comprehensive listing of various exceptions.
7 Conclusion
Whether you are testing internet, intranet or extranet applications, web testing relative to testing for non-web work is more challenging.The quality of web page users have high expectations.In many cases, just as business functions, like the page for the maintenance and development of public relations, so the first impression is very important.