aboutsummaryrefslogtreecommitdiff
path: root/docs/articles/web_only/saem_benchmarks.html
diff options
context:
space:
mode:
Diffstat (limited to 'docs/articles/web_only/saem_benchmarks.html')
-rw-r--r--docs/articles/web_only/saem_benchmarks.html285
1 files changed, 253 insertions, 32 deletions
diff --git a/docs/articles/web_only/saem_benchmarks.html b/docs/articles/web_only/saem_benchmarks.html
index 523d028c..587ee4a2 100644
--- a/docs/articles/web_only/saem_benchmarks.html
+++ b/docs/articles/web_only/saem_benchmarks.html
@@ -33,14 +33,14 @@
</button>
<span class="navbar-brand">
<a class="navbar-link" href="../../index.html">mkin</a>
- <span class="version label label-default" data-toggle="tooltip" data-placement="bottom" title="Released version">1.2.0</span>
+ <span class="version label label-default" data-toggle="tooltip" data-placement="bottom" title="Released version">1.2.3</span>
</span>
</div>
<div id="navbar" class="navbar-collapse collapse">
<ul class="nav navbar-nav">
<li>
- <a href="../../reference/index.html">Functions and data</a>
+ <a href="../../reference/index.html">Reference</a>
</li>
<li class="dropdown">
<a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" data-bs-toggle="dropdown" aria-expanded="false">
@@ -52,6 +52,9 @@
<li>
<a href="../../articles/mkin.html">Introduction to mkin</a>
</li>
+ <li class="divider">
+ </li>
+<li class="dropdown-header">Example evaluations with (generalised) nonlinear least squares</li>
<li>
<a href="../../articles/FOCUS_D.html">Example evaluation of FOCUS Example Dataset D</a>
</li>
@@ -59,22 +62,31 @@
<a href="../../articles/FOCUS_L.html">Example evaluation of FOCUS Laboratory Data L1 to L3</a>
</li>
<li>
- <a href="../../articles/web_only/dimethenamid_2018.html">Example evaluations of dimethenamid data from 2018 with nonlinear mixed-effects models</a>
+ <a href="../../articles/web_only/FOCUS_Z.html">Example evaluation of FOCUS Example Dataset Z</a>
</li>
+ <li class="divider">
+ </li>
+<li class="dropdown-header">Example evaluations with hierarchical models (nonlinear mixed-effects models)</li>
<li>
- <a href="../../articles/web_only/multistart.html">Short demo of the multistart method</a>
+ <a href="../../articles/prebuilt/2022_dmta_parent.html">Testing hierarchical parent degradation kinetics with residue data on dimethenamid and dimethenamid-P</a>
</li>
<li>
- <a href="../../articles/web_only/compiled_models.html">Performance benefit by using compiled model definitions in mkin</a>
+ <a href="../../articles/prebuilt/2022_dmta_pathway.html">Testing hierarchical pathway kinetics with residue data on dimethenamid and dimethenamid-P</a>
</li>
<li>
- <a href="../../articles/web_only/FOCUS_Z.html">Example evaluation of FOCUS Example Dataset Z</a>
+ <a href="../../articles/prebuilt/2022_cyan_pathway.html">Testing hierarchical pathway kinetics with residue data on cyantraniliprole</a>
</li>
<li>
- <a href="../../articles/twa.html">Calculation of time weighted average concentrations with mkin</a>
+ <a href="../../articles/web_only/dimethenamid_2018.html">Comparison of saemix and nlme evaluations of dimethenamid data from 2018</a>
</li>
<li>
- <a href="../../articles/web_only/NAFTA_examples.html">Example evaluation of NAFTA SOP Attachment examples</a>
+ <a href="../../articles/web_only/multistart.html">Short demo of the multistart method</a>
+ </li>
+ <li class="divider">
+ </li>
+<li class="dropdown-header">Performance</li>
+ <li>
+ <a href="../../articles/web_only/compiled_models.html">Performance benefit by using compiled model definitions in mkin</a>
</li>
<li>
<a href="../../articles/web_only/benchmarks.html">Benchmark timings for mkin</a>
@@ -82,6 +94,15 @@
<li>
<a href="../../articles/web_only/saem_benchmarks.html">Benchmark timings for saem.mmkin</a>
</li>
+ <li class="divider">
+ </li>
+<li class="dropdown-header">Miscellaneous</li>
+ <li>
+ <a href="../../articles/twa.html">Calculation of time weighted average concentrations with mkin</a>
+ </li>
+ <li>
+ <a href="../../articles/web_only/NAFTA_examples.html">Example evaluation of NAFTA SOP Attachment examples</a>
+ </li>
</ul>
</li>
<li>
@@ -105,13 +126,15 @@
- </header><script src="saem_benchmarks_files/accessible-code-block-0.0.1/empty-anchor.js"></script><div class="row">
+ </header><div class="row">
<div class="col-md-9 contents">
<div class="page-header toc-ignore">
<h1 data-toc-skip>Benchmark timings for saem.mmkin</h1>
- <h4 data-toc-skip class="author">Johannes Ranke</h4>
+ <h4 data-toc-skip class="author">Johannes
+Ranke</h4>
- <h4 data-toc-skip class="date">Last change 14 November 2022 (rebuilt 2022-11-17)</h4>
+ <h4 data-toc-skip class="date">Last change 17 February 2023
+(rebuilt 2023-04-20)</h4>
<small class="dont-index">Source: <a href="https://github.com/jranke/mkin/blob/HEAD/vignettes/web_only/saem_benchmarks.rmd" class="external-link"><code>vignettes/web_only/saem_benchmarks.rmd</code></a></small>
<div class="hidden name"><code>saem_benchmarks.rmd</code></div>
@@ -120,15 +143,19 @@
-<p>Each system is characterized by operating system type, CPU type, mkin version, saemix version and R version. A compiler was available, so if no analytical solution was available, compiled ODE models are used.</p>
-<p>Every fit is only performed once, so the accuracy of the benchmarks is limited.</p>
+<p>Each system is characterized by operating system type, CPU type, mkin
+version, saemix version and R version. A compiler was available, so if
+no analytical solution was available, compiled ODE models are used.</p>
+<p>Every fit is only performed once, so the accuracy of the benchmarks
+is limited.</p>
<p>For the initial mmkin fits, we use all available cores.</p>
<div class="sourceCode" id="cb1"><pre class="downlit sourceCode r">
<code class="sourceCode R"><span><span class="va">n_cores</span> <span class="op">&lt;-</span> <span class="fu">parallel</span><span class="fu">::</span><span class="fu"><a href="https://rdrr.io/r/parallel/detectCores.html" class="external-link">detectCores</a></span><span class="op">(</span><span class="op">)</span></span></code></pre></div>
<div class="section level2">
<h2 id="test-data">Test data<a class="anchor" aria-label="anchor" href="#test-data"></a>
</h2>
-<p>Please refer to the vignette <code>dimethenamid_2018</code> for an explanation of the following preprocessing.</p>
+<p>Please refer to the vignette <code>dimethenamid_2018</code> for an
+explanation of the following preprocessing.</p>
<div class="sourceCode" id="cb2"><pre class="downlit sourceCode r">
<code class="sourceCode R"><span><span class="va">dmta_ds</span> <span class="op">&lt;-</span> <span class="fu"><a href="https://rdrr.io/r/base/lapply.html" class="external-link">lapply</a></span><span class="op">(</span><span class="fl">1</span><span class="op">:</span><span class="fl">7</span>, <span class="kw">function</span><span class="op">(</span><span class="va">i</span><span class="op">)</span> <span class="op">{</span></span>
<span> <span class="va">ds_i</span> <span class="op">&lt;-</span> <span class="va">dimethenamid_2018</span><span class="op">$</span><span class="va">ds</span><span class="op">[[</span><span class="va">i</span><span class="op">]</span><span class="op">]</span><span class="op">$</span><span class="va">data</span></span>
@@ -163,7 +190,7 @@
<div class="sourceCode" id="cb4"><pre class="downlit sourceCode r">
<code class="sourceCode R"><span><span class="fu"><a href="https://rdrr.io/r/stats/anova.html" class="external-link">anova</a></span><span class="op">(</span></span>
<span> <span class="va">sfo_const</span>, <span class="va">dfop_const</span>, <span class="va">sforb_const</span>, <span class="va">hs_const</span>,</span>
-<span> <span class="va">sfo_tc</span>, <span class="va">dfop_tc</span>, <span class="va">sforb_tc</span>, <span class="va">hs_tc</span><span class="op">)</span> <span class="op">|&gt;</span> <span class="fu">kable</span><span class="op">(</span>, digits <span class="op">=</span> <span class="fl">1</span><span class="op">)</span></span></code></pre></div>
+<span> <span class="va">sfo_tc</span>, <span class="va">dfop_tc</span>, <span class="va">sforb_tc</span>, <span class="va">hs_tc</span><span class="op">)</span> <span class="op">|&gt;</span> <span class="fu"><a href="https://rdrr.io/pkg/knitr/man/kable.html" class="external-link">kable</a></span><span class="op">(</span>, digits <span class="op">=</span> <span class="fl">1</span><span class="op">)</span></span></code></pre></div>
<table class="table">
<thead><tr class="header">
<th align="left"></th>
@@ -231,19 +258,24 @@
</tr>
</tbody>
</table>
-<p>The above model comparison suggests to use the SFORB model with two-component error. For comparison, we keep the DFOP model with two-component error, as it competes with SFORB for biphasic curves.</p>
+<p>The above model comparison suggests to use the SFORB model with
+two-component error. For comparison, we keep the DFOP model with
+two-component error, as it competes with SFORB for biphasic curves.</p>
<div class="sourceCode" id="cb5"><pre class="downlit sourceCode r">
<code class="sourceCode R"><span><span class="fu"><a href="../../reference/illparms.html">illparms</a></span><span class="op">(</span><span class="va">dfop_tc</span><span class="op">)</span></span></code></pre></div>
<pre><code><span><span class="co">## [1] "sd(log_k2)"</span></span></code></pre>
<div class="sourceCode" id="cb7"><pre class="downlit sourceCode r">
<code class="sourceCode R"><span><span class="fu"><a href="../../reference/illparms.html">illparms</a></span><span class="op">(</span><span class="va">sforb_tc</span><span class="op">)</span></span></code></pre></div>
<pre><code><span><span class="co">## [1] "sd(log_k_DMTA_bound_free)"</span></span></code></pre>
-<p>For these two models, random effects for the transformed parameters <code>k2</code> and <code>k_DMTA_bound_free</code> could not be quantified.</p>
+<p>For these two models, random effects for the transformed parameters
+<code>k2</code> and <code>k_DMTA_bound_free</code> could not be
+quantified.</p>
</div>
<div class="section level3">
<h3 id="one-metabolite">One metabolite<a class="anchor" aria-label="anchor" href="#one-metabolite"></a>
</h3>
-<p>We remove parameters that were found to be ill-defined in the parent only fits.</p>
+<p>We remove parameters that were found to be ill-defined in the parent
+only fits.</p>
<div class="sourceCode" id="cb9"><pre class="downlit sourceCode r">
<code class="sourceCode R"><span><span class="va">one_met_mods</span> <span class="op">&lt;-</span> <span class="fu"><a href="https://rdrr.io/r/base/list.html" class="external-link">list</a></span><span class="op">(</span></span>
<span> DFOP_SFO <span class="op">=</span> <span class="fu"><a href="../../reference/mkinmod.html">mkinmod</a></span><span class="op">(</span></span>
@@ -266,7 +298,11 @@
<div class="section level3">
<h3 id="three-metabolites">Three metabolites<a class="anchor" aria-label="anchor" href="#three-metabolites"></a>
</h3>
-<p>For the case of three metabolites, we only keep the SFORB model in order to limit the time for compiling this vignette, and as fitting in parallel may disturb the benchmark. Again, we do not include random effects that were ill-defined in previous fits of subsets of the degradation model.</p>
+<p>For the case of three metabolites, we only keep the SFORB model in
+order to limit the time for compiling this vignette, and as fitting in
+parallel may disturb the benchmark. Again, we do not include random
+effects that were ill-defined in previous fits of subsets of the
+degradation model.</p>
<div class="sourceCode" id="cb10"><pre class="downlit sourceCode r">
<code class="sourceCode R"><span><span class="fu"><a href="../../reference/illparms.html">illparms</a></span><span class="op">(</span><span class="va">sforb_sfo_tc</span><span class="op">)</span></span></code></pre></div>
<div class="sourceCode" id="cb11"><pre class="downlit sourceCode r">
@@ -287,7 +323,9 @@
<div class="section level2">
<h2 id="results">Results<a class="anchor" aria-label="anchor" href="#results"></a>
</h2>
-<p>Benchmarks for all available error models are shown. They are intended for improving mkin, not for comparing CPUs or operating systems. All trademarks belong to their respective owners.</p>
+<p>Benchmarks for all available error models are shown. They are
+intended for improving mkin, not for comparing CPUs or operating
+systems. All trademarks belong to their respective owners.</p>
<div class="section level3">
<h3 id="parent-only-1">Parent only<a class="anchor" aria-label="anchor" href="#parent-only-1"></a>
</h3>
@@ -303,16 +341,68 @@
<th align="right">t3</th>
<th align="right">t4</th>
</tr></thead>
-<tbody><tr class="odd">
+<tbody>
+<tr class="odd">
<td align="left">Ryzen 7 1700</td>
<td align="left">Linux</td>
<td align="left">1.2.0</td>
<td align="left">3.2</td>
-<td align="right">2.14</td>
+<td align="right">2.140</td>
<td align="right">4.626</td>
<td align="right">4.328</td>
<td align="right">4.998</td>
-</tr></tbody>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 7 1700</td>
+<td align="left">Linux</td>
+<td align="left">1.2.2</td>
+<td align="left">3.2</td>
+<td align="right">2.427</td>
+<td align="right">4.550</td>
+<td align="right">4.217</td>
+<td align="right">4.851</td>
+</tr>
+<tr class="odd">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.1</td>
+<td align="left">3.2</td>
+<td align="right">1.352</td>
+<td align="right">2.813</td>
+<td align="right">2.401</td>
+<td align="right">2.074</td>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.2</td>
+<td align="left">3.2</td>
+<td align="right">1.328</td>
+<td align="right">2.738</td>
+<td align="right">2.336</td>
+<td align="right">2.023</td>
+</tr>
+<tr class="odd">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.3</td>
+<td align="left">3.2</td>
+<td align="right">1.118</td>
+<td align="right">2.036</td>
+<td align="right">2.010</td>
+<td align="right">2.088</td>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.3</td>
+<td align="left">3.2</td>
+<td align="right">1.419</td>
+<td align="right">2.374</td>
+<td align="right">1.926</td>
+<td align="right">2.398</td>
+</tr>
+</tbody>
</table>
<p>Two-component error fits for SFO, DFOP, SFORB and HS.</p>
<table class="table">
@@ -326,16 +416,68 @@
<th align="right">t7</th>
<th align="right">t8</th>
</tr></thead>
-<tbody><tr class="odd">
+<tbody>
+<tr class="odd">
<td align="left">Ryzen 7 1700</td>
<td align="left">Linux</td>
<td align="left">1.2.0</td>
<td align="left">3.2</td>
<td align="right">5.678</td>
<td align="right">7.441</td>
-<td align="right">8</td>
-<td align="right">7.98</td>
-</tr></tbody>
+<td align="right">8.000</td>
+<td align="right">7.980</td>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 7 1700</td>
+<td align="left">Linux</td>
+<td align="left">1.2.2</td>
+<td align="left">3.2</td>
+<td align="right">5.352</td>
+<td align="right">7.201</td>
+<td align="right">8.174</td>
+<td align="right">8.401</td>
+</tr>
+<tr class="odd">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.1</td>
+<td align="left">3.2</td>
+<td align="right">2.388</td>
+<td align="right">3.033</td>
+<td align="right">3.532</td>
+<td align="right">3.310</td>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.2</td>
+<td align="left">3.2</td>
+<td align="right">2.341</td>
+<td align="right">2.968</td>
+<td align="right">3.465</td>
+<td align="right">3.341</td>
+</tr>
+<tr class="odd">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.3</td>
+<td align="left">3.2</td>
+<td align="right">2.159</td>
+<td align="right">3.584</td>
+<td align="right">3.307</td>
+<td align="right">3.460</td>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.3</td>
+<td align="left">3.2</td>
+<td align="right">2.348</td>
+<td align="right">3.134</td>
+<td align="right">3.253</td>
+<td align="right">3.530</td>
+</tr>
+</tbody>
</table>
</div>
<div class="section level3">
@@ -351,14 +493,56 @@
<th align="right">t9</th>
<th align="right">t10</th>
</tr></thead>
-<tbody><tr class="odd">
+<tbody>
+<tr class="odd">
<td align="left">Ryzen 7 1700</td>
<td align="left">Linux</td>
<td align="left">1.2.0</td>
<td align="left">3.2</td>
<td align="right">24.465</td>
<td align="right">800.266</td>
-</tr></tbody>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 7 1700</td>
+<td align="left">Linux</td>
+<td align="left">1.2.2</td>
+<td align="left">3.2</td>
+<td align="right">25.193</td>
+<td align="right">798.580</td>
+</tr>
+<tr class="odd">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.1</td>
+<td align="left">3.2</td>
+<td align="right">11.247</td>
+<td align="right">285.216</td>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.2</td>
+<td align="left">3.2</td>
+<td align="right">11.242</td>
+<td align="right">284.258</td>
+</tr>
+<tr class="odd">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.3</td>
+<td align="left">3.2</td>
+<td align="right">11.796</td>
+<td align="right">216.012</td>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.3</td>
+<td align="left">3.2</td>
+<td align="right">12.841</td>
+<td align="right">292.688</td>
+</tr>
+</tbody>
</table>
</div>
<div class="section level3">
@@ -373,13 +557,50 @@
<th align="left">saemix</th>
<th align="right">t11</th>
</tr></thead>
-<tbody><tr class="odd">
+<tbody>
+<tr class="odd">
<td align="left">Ryzen 7 1700</td>
<td align="left">Linux</td>
<td align="left">1.2.0</td>
<td align="left">3.2</td>
<td align="right">1289.198</td>
-</tr></tbody>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 7 1700</td>
+<td align="left">Linux</td>
+<td align="left">1.2.2</td>
+<td align="left">3.2</td>
+<td align="right">1312.445</td>
+</tr>
+<tr class="odd">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.1</td>
+<td align="left">3.2</td>
+<td align="right">489.939</td>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.2</td>
+<td align="left">3.2</td>
+<td align="right">482.970</td>
+</tr>
+<tr class="odd">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.3</td>
+<td align="left">3.2</td>
+<td align="right">392.364</td>
+</tr>
+<tr class="even">
+<td align="left">Ryzen 9 7950X</td>
+<td align="left">Linux</td>
+<td align="left">1.2.3</td>
+<td align="left">3.2</td>
+<td align="right">483.027</td>
+</tr>
+</tbody>
</table>
</div>
</div>
@@ -402,7 +623,7 @@
<div class="pkgdown">
<p></p>
-<p>Site built with <a href="https://pkgdown.r-lib.org/" class="external-link">pkgdown</a> 2.0.6.</p>
+<p>Site built with <a href="https://pkgdown.r-lib.org/" class="external-link">pkgdown</a> 2.0.7.</p>
</div>
</footer>

Contact - Imprint