whizard is hosted by Hepforge, IPPP Durham

Opened 11 years ago

Closed 5 years ago

#563 closed task (duplicate)

Verify ILC 2->6 tests

Reported by: Juergen Reuter Owned by: Juergen Reuter
Priority: P2 Milestone: v2.8.3
Component: core Version: 2.1.1
Severity: normal Keywords:
Cc:

Description (last modified by ohl)

different test schemes, particularly the DEFAULT_CHECKS logic. This should be done in Siegen, Dec 3-5 201[7-9];).

Change History (38)

comment:1 Changed 11 years ago by Juergen Reuter

This unfortunately we missed, will have to do this at the next phone meeting. But most of the clean-up happened.

comment:2 Changed 11 years ago by Juergen Reuter

Summary: Check tests/Makefile.amFinalize self tests

Once all features and commands are reimplemented, we can enable the missing self tests.

comment:3 Changed 11 years ago by Juergen Reuter

Owner: changed from kilian to Juergen Reuter
Status: newassigned

comment:4 Changed 11 years ago by Juergen Reuter

model_test reinstated in r5041. There are now only a few open things.

comment:5 Changed 11 years ago by Juergen Reuter

Owner: changed from Juergen Reuter to kilian
Status: assignednew

comment:6 Changed 11 years ago by Juergen Reuter

Owner: changed from kilian to Juergen Reuter
Priority: P2P4
Status: newassigned

This can only be finalized at the very end.

comment:7 Changed 11 years ago by Juergen Reuter

This is a list of missing (not yet re-implemented) self tests:

  1. libs.sin (#583)
  2. user_cuts.sin (#529)
  3. user_strfun.sin (#529)
  4. ilc.sin (#500)
  5. fsr_shower.sin (#44)
  6. isr_shower.sin (#44)
  7. jets.sin (#44, #545)
  8. sm_ext.sin
Version 0, edited 11 years ago by Juergen Reuter (next)

comment:8 Changed 11 years ago by Juergen Reuter

MSSM extended self tests: mssm_ext-aa.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-bb.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-bt.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-dd.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-dd2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ddckm.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-dg.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ee.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ee2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-en.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ga.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-gg.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-gw.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-gz.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-tn.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-tt.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ug.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-uu.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-uu2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-uuckm.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-wa.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ww.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-wz.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-za.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-zz.run --- works 64bit (dbl+quad) + 32bit (dbl+quad)

So, apparently all MSSM tests work on 64bit.

Last edited 11 years ago by Juergen Reuter (previous) (diff)

comment:9 Changed 11 years ago by Juergen Reuter

NMSSM extended self tests: nmssm_ext-aa.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-bb1.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-bb2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-bt.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-dd1.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-dd2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-ee1.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-ee2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-en.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-ga.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-gg.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-gw.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-gz.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-qg.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-tn.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-tt1.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-tt2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-uu1.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-uu2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-wa.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-ww1.run --- works 64bit (dbl+quad) + 32bit (dbl+qquad) nmssm_ext-ww2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-wz.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-za.run --- works 64bit (dbl+quad) + 32bit (dbl+quad)

Last edited 11 years ago by Juergen Reuter (previous) (diff)

comment:10 Changed 11 years ago by Juergen Reuter

nmssm_ext-tt2.run leads to 1 failure in the process e3, E3 => h01 h01:

************************************************************************
* Checking e3,E3 => h01,h01	 @ sqrt(s) = 5000 GeV
************************************************************************
[user variable] error_sum =  2.769089683983E-07
Expecting 4.9290295E-06
integral(nmssm_ext_tt2_50) =  3.960746804051E-06
[user variable] pull =  3.496754552769E+00
WARNING: pull > 3 in e3,E3 => h01,h01	 @ sqrt(s) = 5000 GeV
tolerance =  8.307269051948E-07
******************************************************************************
*** ERROR: expect: failure
******************************************************************************

Will have to look into this.

comment:11 in reply to:  10 ; Changed 11 years ago by Juergen Reuter

Replying to jr_reuter:

nmssm_ext-tt2.run leads to 1 failure in the process e3, E3 => h01 h01:

************************************************************************
* Checking e3,E3 => h01,h01	 @ sqrt(s) = 5000 GeV
************************************************************************
[user variable] error_sum =  2.769089683983E-07
Expecting 4.9290295E-06
integral(nmssm_ext_tt2_50) =  3.960746804051E-06
[user variable] pull =  3.496754552769E+00
WARNING: pull > 3 in e3,E3 => h01,h01	 @ sqrt(s) = 5000 GeV
tolerance =  8.307269051948E-07
******************************************************************************
*** ERROR: expect: failure
******************************************************************************

Will have to look into this.

It turns out, this has difficulties to find all channels. Given enough calls, we get the desired result. Maybe I try a different seed. But it's nothing to worry about.

comment:12 in reply to:  11 Changed 11 years ago by Juergen Reuter

Replying to jr_reuter:

Replying to jr_reuter:

nmssm_ext-tt2.run leads to 1 failure in the process e3, E3 => h01 h01:

************************************************************************
* Checking e3,E3 => h01,h01	 @ sqrt(s) = 5000 GeV
************************************************************************
[user variable] error_sum =  2.769089683983E-07
Expecting 4.9290295E-06
integral(nmssm_ext_tt2_50) =  3.960746804051E-06
[user variable] pull =  3.496754552769E+00
WARNING: pull > 3 in e3,E3 => h01,h01	 @ sqrt(s) = 5000 GeV
tolerance =  8.307269051948E-07
******************************************************************************
*** ERROR: expect: failure
******************************************************************************

Will have to look into this.

It turns out, this has difficulties to find all channels. Given enough calls, we get the desired result. Maybe I try a different seed. But it's nothing to worry about.

In r5653 this has been fixed by enhancing the number of iterations and calls for this particular part of the NMSSM test suite.

comment:13 in reply to:  9 Changed 11 years ago by Juergen Reuter

Replying to jr_reuter:

NMSSM extended self tests: nmssm_ext-aa.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-bb1.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-bb2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-bt.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-dd1.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-dd2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-ee1.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-ee2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-en.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-ga.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-gg.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-gw.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-gz.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-qg.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-tn.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-tt1.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-tt2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-uu1.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-uu2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-wa.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-ww1.run --- works 64bit (dbl+quad) + 32bit (dbl+qquad) nmssm_ext-ww2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-wz.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) nmssm_ext-za.run --- works 64bit (dbl+quad) + 32bit (dbl+quad)

So, the NMSSM tests run through on 32 and 64 bit with 8 and 10 byte precision.

comment:14 in reply to:  8 Changed 11 years ago by Juergen Reuter

Replying to jr_reuter:

MSSM extended self tests: mssm_ext-aa.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-bb.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-bt.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-dd.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-dd2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ddckm.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-dg.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ee.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ee2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-en.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ga.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-gg.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-gw.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-gz.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-tn.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-tt.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ug.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-uu.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-uu2.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-uuckm.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-wa.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-ww.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-wz.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-za.run --- works 64bit (dbl+quad) + 32bit (dbl+quad) mssm_ext-zz.run --- works 64bit (dbl+quad) + 32bit (dbl+quad)

So, apparently all MSSM tests work on 64bit and 32bit with 8 and 10 byte precision.

comment:15 Changed 11 years ago by Juergen Reuter

Milestone: v2.2.0v2.2.1
Summary: Finalize self testsVerify ILC 2->6 tests

User cut and user structure function tests are implemented as XFAIL and will be deferred to #529. This ticket remains as ticket for the ILC 2->6 precision tests (shifted to a later version)

comment:16 Changed 11 years ago by Juergen Reuter

Milestone: v2.2.1v2.3.1

comment:17 Changed 9 years ago by Juergen Reuter

Milestone: v2.3.1v2.3.0
Priority: P4P2

comment:18 Changed 9 years ago by kilian

Owner: changed from Juergen Reuter to zhao
Status: assignednew

comment:19 Changed 8 years ago by Juergen Reuter

Milestone: v2.3.0v2.3.1

comment:20 Changed 8 years ago by Juergen Reuter

Milestone: v2.3.1v2.3.2

comment:21 Changed 8 years ago by Juergen Reuter

Milestone: v2.3.2v2.4.0

Milestone renamed

comment:22 Changed 8 years ago by Juergen Reuter

Milestone: v2.4.0v2.4.1

comment:23 Changed 8 years ago by Juergen Reuter

Milestone: v2.4.1v2.5.0

Milestone renamed

comment:24 Changed 8 years ago by Juergen Reuter

Milestone: v2.5.0v2.6.0

comment:25 Changed 7 years ago by ohl

Owner: changed from zhao to Juergen Reuter

comment:26 Changed 7 years ago by ohl

Description: modified (diff)

comment:27 Changed 7 years ago by Juergen Reuter

Milestone: v2.6.0v2.6.1

comment:28 Changed 7 years ago by Juergen Reuter

Milestone: v2.6.1v2.6.2

comment:29 Changed 7 years ago by Juergen Reuter

Milestone: v2.6.2v2.6.3

comment:30 Changed 7 years ago by Juergen Reuter

Milestone: v2.6.3v2.6.4

comment:31 Changed 6 years ago by Juergen Reuter

Milestone: v2.6.4v2.6.5

comment:32 Changed 6 years ago by Juergen Reuter

Milestone: v2.6.5v2.7.0

Milestone renamed

comment:33 Changed 6 years ago by Juergen Reuter

Milestone: v2.7.0v2.7.1

comment:34 Changed 6 years ago by Juergen Reuter

Milestone: v2.7.1v2.8.0

comment:35 Changed 6 years ago by Juergen Reuter

Milestone: v2.8.0v2.8.1

comment:36 Changed 5 years ago by Juergen Reuter

Milestone: v2.8.1v2.8.2

Milestone renamed

comment:37 Changed 5 years ago by Juergen Reuter

Milestone: v2.8.2v2.8.3

comment:38 Changed 5 years ago by Juergen Reuter

Resolution: duplicate
Status: newclosed

Transferred to Gitlab issue 309.

Note: See TracTickets for help on using tickets.