Thread: Test Coverage


Permlink Replies: 9 - Pages: 1 - Last Post: Oct 19, 2012 11:06 AM Last Post By: Leo_BR
Leo_BR

Posts: 19
Registered: 03/14/12
Test Coverage
Posted: Aug 30, 2012 2:34 PM
Click to report abuse...   Click to reply to this thread Reply
Have how to make a log type file (.txt or .log) of all the tests that are running on the testplan?

For example, select a template from version to test the card and generates this file pointed to the tests run of that time, then selects another version model to compare what each version is being tested. This comparison even agent would.
oconnellj

Posts: 93
Registered: 03/06/09
Re: Test Coverage
Posted: Sep 12, 2012 3:56 AM   in response to: Leo_BR in response to: Leo_BR
Click to report abuse...   Click to reply to this thread Reply
Hi Leo,

you can log all the raw test data and send it directly to a folder - this will record every test carried out and every measurement, so maybe you dont want to do this every time since it will create a lot oif data, so maybe just put in for first run of the test.

then you could write a script to extract just the reference designators -

but i am not sure what you are actually really trying to achieve ? your title suggests test coverage is what is needed

you mention versions - the test program can handle multiple variants via testorder file, and the flag bvi$ in tetsplan does hold the current board version - so if you need to know what board versionis being tetsed and what is actually tested - you can use the board version specific parts,

you can run the test coverage reporting(coverage analyst) - there is a new tool called testplan analyser which creates an excel sheet that should tell you exactly what is and is not tested for your board
Leo_BR

Posts: 19
Registered: 03/14/12
Re: Test Coverage
Posted: Sep 13, 2012 1:55 PM   in response to: oconnellj in response to: oconnellj
Click to report abuse...   Click to reply to this thread Reply
Hi oconnellj,

Would send me or give an example of this new tool called analyzer testplan? Because I do not know.
I wanted to test the board "A" with version "1" and generate a report that is being tested in this version, then test the board "A" with version "2" and generate another report on what is being tested in this release. I tried the testplan generate a log, but it did not work, so I resorted to help.
I'm needing this coverage would help me?
Leo_BR

Posts: 19
Registered: 03/14/12
Re: Test Coverage
Posted: Sep 19, 2012 5:08 AM   in response to: Leo_BR in response to: Leo_BR
Click to report abuse...   Click to reply to this thread Reply
Hello,

Would someone help me or explain better this new application analyzer testplan?
adrianc


Posts: 62
Registered: 04/08/08
Re: Test Coverage
Posted: Sep 19, 2012 5:27 AM   in response to: Leo_BR in response to: Leo_BR
Click to report abuse...   Click to reply to this thread Reply
Hi Leo_BR,
I think it is easier for you to see the report from the "testplan analyser".
Please see the sample from one of our demo boards.
It is a test coverage report in Excel format.
The actual test coverage is not good for this board, since it is just a demo.

rgds ... adrian
Leo_BR

Posts: 19
Registered: 03/14/12
Re: Test Coverage
Posted: Sep 19, 2012 8:07 AM   in response to: adrianc in response to: adrianc
Click to report abuse...   Click to reply to this thread Reply
Very good, but how do I generate this file?
adrianc


Posts: 62
Registered: 04/08/08
Re: Test Coverage
Posted: Sep 23, 2012 9:31 PM   in response to: Leo_BR in response to: Leo_BR
Click to report abuse...   Click to reply to this thread Reply
Hi Leo_BR,
The testplan analyser is found as an option in the Coverage Analyst software ("Enable Testplan Analyzer"). After setting this option, the excel report will be found in a TPA_report directory in the board directory after the execution of the Coverage Analyst report generation.

You will see this in software release 07.20pc and 08.10p (08.00p was skipped) and onwards.

Hope this helps.

rgds ... adrian
Leo_BR

Posts: 19
Registered: 03/14/12
Re: Test Coverage
Posted: Sep 25, 2012 10:07 AM   in response to: adrianc in response to: adrianc
Click to report abuse...   Click to reply to this thread Reply
Does not work here because the tesplan is very customized because of versions. This tool I already knew, but how does not work because the customizations I decided to ask for help on the Forum.
If he had someone help me with the own testplan generating this log file would be better.

Thank you.
adrianc


Posts: 62
Registered: 04/08/08
Re: Test Coverage
Posted: Sep 26, 2012 12:23 AM   in response to: Leo_BR in response to: Leo_BR
Click to report abuse...   Click to reply to this thread Reply
Leo_BR,
Then, I suggest that you use your log files as reference as suggested by Jon.
Normally, the log files are stored in the \qm\pbq\ directory. If you set in your testplan to "QSTATS_Mode = Histo" and "Analog_Sample_Rate = 1", you will get a log file for each test that is executed in the testplan for that version.

Once you have verified that all the tests are there, you can delete the log files and execute the testplan for the next version.

If you want, you can create a script to output the list of files in the \qm\pbq\<board> directory into a file for easier reading.

Or you could try the following ...
  • from a shell window, navigate to the \qm\pbq\<board> directory, where <board> is your board test directory name
  • at the command prompt, execute the following command
ls *.mes > testlist_<version>
This will result in a file (testlist_<version>) with the list of *.mes files, one for each test (or subtest) executed.

Hope this works for you.

rgds ... adrian
Leo_BR

Posts: 19
Registered: 03/14/12
Re: Test Coverage
Posted: Oct 19, 2012 11:06 AM   in response to: adrianc in response to: adrianc
Click to report abuse...   Click to reply to this thread Reply
Thanks for the help, but not ran right this feature.

There are all the files that are generated in this report. Did some testing here and did not generate even half of analog components that the test has.

I've tried every way, but the one that I'm seeing what could go right would be put at the testplan something that makes him create a log file for that every time I pass by some component the test write this log on which component the test is passing. For example if your test is testing the C1 would be added to the log that the C1 has been tested. If anyone knows help me I'll be grateful.

Point your RSS reader here for a feed of the latest messages in all forums