No document available at http://datatracker.ietf.org/doc/draft-rescorla-rtcweb-generic-idp/

[ietf-svn-bot]

owner:olau@iola.dk resolution_fixed type_defect | by magnus.westerlund@ericsson.com

---

Opening page:
http://datatracker.ietf.org/doc/draft-rescorla-rtcweb-generic-idp/

I only get the message:
Error; cannot read (draft-rescorla-rtcweb-generic-idp,01,html)

Where the document should be displayed. Also the plain text link is not working and results in a
404: Page Not Found
http://www.ietf.org/id/draft-rescorla-rtcweb-generic-idp-01.txt

---

Issue migrated from trac:813 at 2022-03-04 02:30:27 +0000

[ietf-svn-bot]

@henrik@levkowetz.com changed owner from `` to olau@iola.dk

[ietf-svn-bot]

@henrik@levkowetz.com commented

---

I found the document in the archive; and have now moved it back to the repository.

This is the second instance I've seen of a newly posted document being moved
prematurely to the archive; I think we need to look a bit more closely at the
expiration code.

[ietf-svn-bot]

@henrik@levkowetz.com changed priority from n/a to major

[ietf-svn-bot]

@henrik@levkowetz.com changed component from doc/ to submit/

[ietf-svn-bot]

@henrik@levkowetz.com commented

---

I just checked the archive for files less than 185 days old, and found 1338 of them. Looking
at the content of the newest couple of hundred files, they all have recent dates, which seems
to match the file date. Some of these may of course have been moved because newer drafts
have been posted, but as far as I can see there are a lot of drafts in the archive which
shouldn't be there, but instead in the repository. I'm going to clean that up now, but we
need to find and fix the cause of this.

[ietf-svn-bot]

@olau@iola.dk commented

---

I had a look at the expire code, but the logic there is pretty straightforward and I can't figure out a way it could move the files of this draft given the state of it.

However, looking at history tab for draft-rescorla-rtcweb-generic-idp, it seems revision 01 has been accepted twice? I think this could explain the missing files. In the middle of the post the submit code moves the current draft files to the archive. This was something Ryan suggested, I think.

Looking at the pathways leading to the post code, they do seem to guard against the draft being posted twice by checking the state of the submission. So the only explanation I can think of is a concurrency problem. It does look like the two posts happened exactly at the same second. If you accidentally press the button twice in a row and the mail server is slow, I think you can end up with two threads both concluding it's safe to post.

I think we need some code to prevent the double submits.

[ietf-svn-bot]

@henrik@levkowetz.com commented

---

Good analysis.

The code which moves the previous version to the archive could do exactly that -- not moving
all documents which match the document name plus any version number and any extension to the
archive, but only specifically instances of the previous version (with any extension).

(In addition to the possible draft-foo-bar.txt, there could also be .pdf, .ps, .html, .xml,
.txt.p7s (authenticity signature files) and others; so I think it's OK to blanket move any
with the previous revision to the archive.)

[ietf-svn-bot]

@olau@iola.dk commented

---

0bc71c7 has two fixes that addresses this.

In addition, I've run a query on the database to check for duplicate revisions:

mysql> select doc_id, rev, count(*) c from doc_newrevisiondocevent n, doc_docevent e where n.docevent_ptr_id = e.id and e.time >= "2012-02-01" group by doc_id, rev having c > 1;
+--------------------------------------------+-----+----+
| doc_id                                     | rev | c  |
+--------------------------------------------+-----+----+
| draft-cui-tictoc-encrypted-synchronization | 00  | 12 |
| draft-rescorla-rtcweb-generic-idp          | 01  |  2 |
+--------------------------------------------+-----+----+
2 rows in set (1.67 sec)

So it looks like this particular problem is limited to these two.

Unfortunately running the above query on the whole database finds a bunch of old duplicates, I think it's strange the importer imported those, but perhaps one of the last minute changes prevented it from catching them:

mysql> select doc_id, rev, count(*) c from doc_newrevisiondocevent n, doc_docevent e where n.docevent_ptr_id = e.id group by doc_id, rev having c > 1;
+--------------------------------------------+-----+----+
| doc_id                                     | rev | c  |
+--------------------------------------------+-----+----+
| draft-aboba-sg-experiment                  | 03  |  2 |
| draft-arkko-pppext-eap-aka                 | 15  |  2 |
| draft-babiarz-pcn-explicit-marking         | 02  |  2 |
| draft-bonica-tcp-auth                      | 06  |  2 |
| draft-cakulev-ibake                        | 05  |  9 |
| draft-charny-pcn-single-marking            | 02  |  2 |
| draft-cui-tictoc-encrypted-synchronization | 00  | 12 |
| draft-dondeti-oma-sip-sdp-attrs            | 02  |  3 |
| draft-ietf-ccamp-gmpls-vcat-lcas           | 13  |  3 |
| draft-ietf-ecrit-lost                      | 10  |  2 |
| draft-ietf-forces-protocol                 | 12  |  2 |
| draft-ietf-imapext-sort                    | 16  |  2 |
| draft-ietf-iptel-tgrep                     | 07  |  2 |
| draft-ietf-manet-jitter                    | 04  |  2 |
| draft-ietf-mmusic-ice                      | 17  |  2 |
| draft-ietf-mpls-fastreroute-mib            | 16  |  2 |
| draft-ietf-mpls-mp-ldp-reqs                | 07  |  2 |
| draft-ietf-nfsv4-pnfs-obj                  | 03  |  2 |
| draft-ietf-nntpext-authinfo                | 01  |  2 |
| draft-ietf-nntpext-authinfo                | 02  |  2 |
| draft-ietf-pana-statemachine               | 13  |  2 |
| draft-ietf-pki4ipsec-ikecert-profile       | 09  |  2 |
| draft-ietf-pwe3-satop                      | 02  |  2 |
| draft-ietf-rmonmib-rmon2-v2                | 02  |  2 |
| draft-ietf-rserpool-common-param           | 11  |  2 |
| draft-ietf-sieve-body                      | 08  |  2 |
| draft-ietf-sieve-notify-sip-message        | 08  |  2 |
| draft-ietf-simple-filter-format            | 04  |  2 |
| draft-ietf-sipping-config-framework        | 15  |  2 |
| draft-ietf-smime-cms-auth-enveloped        | 05  |  2 |
| draft-ietf-tsvwg-emergency-rsvp            | 13  |  2 |
| draft-ietf-tsvwg-sctpthreat                | 01  |  2 |
| draft-ietf-webdav-bind                     | 20  |  2 |
| draft-ietf-xcon-framework                  | 06  |  2 |
| draft-ietf-xcon-framework                  | 10  |  2 |
| draft-lee-ipsec-cipher-seed                | 01  |  2 |
| draft-lepinski-dh-groups                   | 02  |  2 |
| draft-orly-atommib-rfc3895bis              | 01  |  2 |
| draft-rescorla-rtcweb-generic-idp          | 01  |  2 |
| draft-rfc-editor-rfc2223bis                | 08  |  2 |
| draft-shin-augmented-pake                  | 06  |  5 |
+--------------------------------------------+-----+----+
41 rows in set (12.17 sec)

Here's a snippet for cleaning up (or printing a report if you set dry_run=True) by only keeping the first entry if the time difference is < 2 days:

from ietf.doc.models import *
dups = [("draft-aboba-sg-experiment", "03"),
("draft-arkko-pppext-eap-aka", "15"),
("draft-babiarz-pcn-explicit-marking", "02"),
("draft-bonica-tcp-auth", "06"),
("draft-cakulev-ibake", "05"),
("draft-charny-pcn-single-marking", "02"),
("draft-cui-tictoc-encrypted-synchronization", "00"),
("draft-dondeti-oma-sip-sdp-attrs", "02"),
("draft-ietf-ccamp-gmpls-vcat-lcas", "13"),
("draft-ietf-ecrit-lost", "10"),
("draft-ietf-forces-protocol", "12"),
("draft-ietf-imapext-sort", "16"),
("draft-ietf-iptel-tgrep", "07"),
("draft-ietf-manet-jitter", "04"),
("draft-ietf-mmusic-ice", "17"),
("draft-ietf-mpls-fastreroute-mib", "16"),
("draft-ietf-mpls-mp-ldp-reqs", "07"),
("draft-ietf-nfsv4-pnfs-obj", "03"),
("draft-ietf-nntpext-authinfo", "01"),
("draft-ietf-nntpext-authinfo", "02"),
("draft-ietf-pana-statemachine", "13"),
("draft-ietf-pki4ipsec-ikecert-profile", "09"),
("draft-ietf-pwe3-satop", "02"),
("draft-ietf-rmonmib-rmon2-v2", "02"),
("draft-ietf-rserpool-common-param", "11"),
("draft-ietf-sieve-body", "08"),
("draft-ietf-sieve-notify-sip-message", "08"),
("draft-ietf-simple-filter-format", "04"),
("draft-ietf-sipping-config-framework", "15"),
("draft-ietf-smime-cms-auth-enveloped", "05"),
("draft-ietf-tsvwg-emergency-rsvp", "13"),
("draft-ietf-tsvwg-sctpthreat", "01"),
("draft-ietf-webdav-bind", "20"),
("draft-ietf-xcon-framework", "06"),
("draft-ietf-xcon-framework", "10"),
("draft-lee-ipsec-cipher-seed", "01"),
("draft-lepinski-dh-groups", "02"),
("draft-orly-atommib-rfc3895bis", "01"),
("draft-rescorla-rtcweb-generic-idp", "01"),
("draft-rfc-editor-rfc2223bis", "08"),
("draft-shin-augmented-pake", "06"),]
def delete_dups(l, dry_run=False, keep_first=True):
    if keep_first:
        keep = l[0]
        delete = l[1:]
    else:
        keep = l[-1]
        delete = l[:-1]
    print "    keeping ", keep.time, keep.doc, keep.rev
    for e in delete:
        print "    deleting", e.time, e.doc, e.rev
        if not dry_run:
            e.delete()

for name, rev in dups:
    l = list(NewRevisionDocEvent.objects.filter(doc=name, rev=rev).order_by("time"))
    if len(l) < 2:
        continue
    delta = l[-1].time - l[0].time
    if delta.days <= 1:
        delete_dups(l)
    else:
        print delta, "https://datatracker.ietf.org/doc/%s/history/" % l[0].doc, l[0].rev, "dups", len(l) - 1, "start", l[0].time, "end", l[-1].time

It leaves me with a few entries that require manual inspection.

[ietf-svn-bot]

@olau@iola.dk commented

---

Oops, I meant < 1 day.

[ietf-svn-bot]

@henrik@levkowetz.com commented

---

Done. Capturing the output here, for manual followup of remaining dubious entries:

    keeping  2007-10-11 17:07:04 draft-aboba-sg-experiment 03
    deleting 2007-10-11 17:20:46 draft-aboba-sg-experiment 03
    keeping  2004-12-27 13:39:46 draft-arkko-pppext-eap-aka 15
    deleting 2004-12-27 13:44:36 draft-arkko-pppext-eap-aka 15
    keeping  2007-11-19 05:49:37 draft-babiarz-pcn-explicit-marking 02
    deleting 2007-11-20 12:08:26 draft-babiarz-pcn-explicit-marking 02
    keeping  2007-02-14 12:41:06 draft-bonica-tcp-auth 06
    deleting 2007-02-14 12:41:06 draft-bonica-tcp-auth 06
    keeping  2011-10-19 07:45:57 draft-cakulev-ibake 05
    deleting 2011-10-19 07:46:29 draft-cakulev-ibake 05
    deleting 2011-10-19 07:46:32 draft-cakulev-ibake 05
    deleting 2011-10-19 07:49:33 draft-cakulev-ibake 05
    deleting 2011-10-19 07:50:55 draft-cakulev-ibake 05
    deleting 2011-10-19 07:58:11 draft-cakulev-ibake 05
    deleting 2011-10-19 08:43:22 draft-cakulev-ibake 05
    deleting 2011-10-19 08:51:36 draft-cakulev-ibake 05
    deleting 2011-10-19 09:07:41 draft-cakulev-ibake 05
    keeping  2007-07-12 12:22:01 draft-charny-pcn-single-marking 02
    deleting 2007-07-12 12:22:02 draft-charny-pcn-single-marking 02
    keeping  2012-02-29 20:13:20 draft-cui-tictoc-encrypted-synchronization 00
    deleting 2012-02-29 20:14:13 draft-cui-tictoc-encrypted-synchronization 00
    deleting 2012-02-29 20:15:10 draft-cui-tictoc-encrypted-synchronization 00
    deleting 2012-02-29 20:15:44 draft-cui-tictoc-encrypted-synchronization 00
    deleting 2012-02-29 21:07:06 draft-cui-tictoc-encrypted-synchronization 00
    deleting 2012-02-29 21:08:07 draft-cui-tictoc-encrypted-synchronization 00
    deleting 2012-02-29 21:08:49 draft-cui-tictoc-encrypted-synchronization 00
    deleting 2012-02-29 21:24:44 draft-cui-tictoc-encrypted-synchronization 00
    deleting 2012-02-29 22:06:23 draft-cui-tictoc-encrypted-synchronization 00
    deleting 2012-02-29 22:58:57 draft-cui-tictoc-encrypted-synchronization 00
    deleting 2012-03-01 00:34:15 draft-cui-tictoc-encrypted-synchronization 00
    deleting 2012-03-01 01:04:27 draft-cui-tictoc-encrypted-synchronization 00
33 days, 15:13:40 https://datatracker.ietf.org/doc/draft-dondeti-oma-sip-sdp-attrs/history/ 02 dups 2 start 2007-10-16 13:53:36 end 2007-11-19 05:07:16
    keeping  2011-05-04 08:59:02 draft-ietf-ccamp-gmpls-vcat-lcas 13
    deleting 2011-05-04 08:59:28 draft-ietf-ccamp-gmpls-vcat-lcas 13
    deleting 2011-05-04 09:03:16 draft-ietf-ccamp-gmpls-vcat-lcas 13
    keeping  2008-05-28 12:41:48 draft-ietf-ecrit-lost 10
    deleting 2008-05-28 12:41:48 draft-ietf-ecrit-lost 10
15 days, 21:42:40 https://datatracker.ietf.org/doc/draft-ietf-forces-protocol/history/ 12 dups 1 start 2007-11-18 23:58:03 end 2007-12-04 21:40:43
    keeping  2004-05-04 10:07:39 draft-ietf-imapext-sort 16
    deleting 2004-05-04 10:07:45 draft-ietf-imapext-sort 16
    keeping  2006-02-22 11:57:01 draft-ietf-iptel-tgrep 07
    deleting 2006-02-22 11:57:27 draft-ietf-iptel-tgrep 07
    keeping  2007-12-04 18:58:33 draft-ietf-manet-jitter 04
    deleting 2007-12-04 18:59:22 draft-ietf-manet-jitter 04
    keeping  2007-07-12 12:30:13 draft-ietf-mmusic-ice 17
    deleting 2007-07-12 12:30:13 draft-ietf-mmusic-ice 17
    keeping  2011-01-18 09:55:49 draft-ietf-mpls-fastreroute-mib 16
    deleting 2011-01-18 09:55:52 draft-ietf-mpls-fastreroute-mib 16
    keeping  2011-05-12 03:24:32 draft-ietf-mpls-mp-ldp-reqs 07
    deleting 2011-05-12 03:24:42 draft-ietf-mpls-mp-ldp-reqs 07
    keeping  2007-03-07 15:32:55 draft-ietf-nfsv4-pnfs-obj 03
    deleting 2007-03-07 15:32:55 draft-ietf-nfsv4-pnfs-obj 03
21 days, 0:09:02 https://datatracker.ietf.org/doc/draft-ietf-nntpext-authinfo/history/ 01 dups 1 start 2004-06-17 09:04:12 end 2004-07-08 09:13:14
4 days, 1:00:28 https://datatracker.ietf.org/doc/draft-ietf-nntpext-authinfo/history/ 02 dups 1 start 2004-07-08 09:12:45 end 2004-07-12 10:13:13
3 days, 0:36:18 https://datatracker.ietf.org/doc/draft-ietf-pana-statemachine/history/ 13 dups 1 start 2009-07-04 00:14:36 end 2009-07-07 00:50:54
24 days, 20:18:06 https://datatracker.ietf.org/doc/draft-ietf-pki4ipsec-ikecert-profile/history/ 09 dups 1 start 2006-03-23 14:45:07 end 2006-04-17 11:03:13
350 days, 2:12:06 https://datatracker.ietf.org/doc/draft-ietf-pwe3-satop/history/ 02 dups 1 start 2004-07-21 11:34:21 end 2005-07-06 13:46:27
13 days, 4:39:10 https://datatracker.ietf.org/doc/draft-ietf-rmonmib-rmon2-v2/history/ 02 dups 1 start 2004-10-07 11:16:50 end 2004-10-20 15:56:00
    keeping  2006-10-19 14:48:03 draft-ietf-rserpool-common-param 11
    deleting 2006-10-19 14:48:03 draft-ietf-rserpool-common-param 11
    keeping  2008-03-13 15:55:20 draft-ietf-sieve-body 08
    deleting 2008-03-13 15:56:28 draft-ietf-sieve-body 08
    keeping  2011-10-11 12:14:29 draft-ietf-sieve-notify-sip-message 08
    deleting 2011-10-11 12:16:09 draft-ietf-sieve-notify-sip-message 08
    keeping  2005-01-14 12:29:22 draft-ietf-simple-filter-format 04
    deleting 2005-01-14 12:34:20 draft-ietf-simple-filter-format 04
11 days, 23:06:17 https://datatracker.ietf.org/doc/draft-ietf-sipping-config-framework/history/ 15 dups 1 start 2008-02-01 08:56:02 end 2008-02-13 08:02:19
    keeping  2007-09-13 10:18:58 draft-ietf-smime-cms-auth-enveloped 05
    deleting 2007-09-13 10:18:58 draft-ietf-smime-cms-auth-enveloped 05
7 days, 1:41:13 https://datatracker.ietf.org/doc/draft-ietf-tsvwg-emergency-rsvp/history/ 13 dups 1 start 2009-11-16 23:24:18 end 2009-11-24 01:05:31
    keeping  2006-08-07 13:44:42 draft-ietf-tsvwg-sctpthreat 01
    deleting 2006-08-07 13:44:42 draft-ietf-tsvwg-sctpthreat 01
    keeping  2007-11-15 09:42:14 draft-ietf-webdav-bind 20
    deleting 2007-11-15 10:38:06 draft-ietf-webdav-bind 20
    keeping  2006-12-05 13:53:43 draft-ietf-xcon-framework 06
    deleting 2006-12-05 13:53:43 draft-ietf-xcon-framework 06
    keeping  2007-11-09 13:07:59 draft-ietf-xcon-framework 10
    deleting 2007-11-09 13:08:13 draft-ietf-xcon-framework 10
    keeping  2005-03-21 14:14:06 draft-lee-ipsec-cipher-seed 01
    deleting 2005-03-21 14:15:47 draft-lee-ipsec-cipher-seed 01
    keeping  2007-11-05 16:56:24 draft-lepinski-dh-groups 02
    deleting 2007-11-05 17:00:44 draft-lepinski-dh-groups 02
41 days, 1:21:43 https://datatracker.ietf.org/doc/draft-orly-atommib-rfc3895bis/history/ 01 dups 1 start 2006-08-14 11:14:47 end 2006-09-24 12:36:30
    keeping  2012-03-12 15:56:37 draft-rescorla-rtcweb-generic-idp 01
    deleting 2012-03-12 15:56:37 draft-rescorla-rtcweb-generic-idp 01
    keeping  2004-07-20 12:48:11 draft-rfc-editor-rfc2223bis 08
    deleting 2004-07-20 12:48:26 draft-rfc-editor-rfc2223bis 08
    keeping  2011-05-10 01:11:35 draft-shin-augmented-pake 06
    deleting 2011-05-10 01:11:58 draft-shin-augmented-pake 06
    deleting 2011-05-10 01:12:36 draft-shin-augmented-pake 06
    deleting 2011-05-10 01:13:58 draft-shin-augmented-pake 06
    deleting 2011-05-10 01:14:26 draft-shin-augmented-pake 06

[ietf-svn-bot]

@henrik@levkowetz.com commented

---

These are the remaining entries:

• 11d https://datatracker.ietf.org/doc/draft-ietf-sipping-config-framework/history/ 15 dups 1 start 2008-02-01 08:56:02 end 2008-02-13 08:02:19
• 13d https://datatracker.ietf.org/doc/draft-ietf-rmonmib-rmon2-v2/history/ 02 dups 1 start 2004-10-07 11:16:50 end 2004-10-20 15:56:00
• 15d https://datatracker.ietf.org/doc/draft-ietf-forces-protocol/history/ 12 dups 1 start 2007-11-18 23:58:03 end 2007-12-04 21:40:43
• 21d https://datatracker.ietf.org/doc/draft-ietf-nntpext-authinfo/history/ 01 dups 1 start 2004-06-17 09:04:12 end 2004-07-08 09:13:14
• 24d https://datatracker.ietf.org/doc/draft-ietf-pki4ipsec-ikecert-profile/history/ 09 dups 1 start 2006-03-23 14:45:07 end 2006-04-17 11:03:13
• 3d https://datatracker.ietf.org/doc/draft-ietf-pana-statemachine/history/ 13 dups 1 start 2009-07-04 00:14:36 end 2009-07-07 00:50:54
• 33d https://datatracker.ietf.org/doc/draft-dondeti-oma-sip-sdp-attrs/history/ 02 dups 2 start 2007-10-16 13:53:36 end 2007-11-19 05:07:16
• 350d https://datatracker.ietf.org/doc/draft-ietf-pwe3-satop/history/ 02 dups 1 start 2004-07-21 11:34:21 end 2005-07-06 13:46:27
• 4d https://datatracker.ietf.org/doc/draft-ietf-nntpext-authinfo/history/ 02 dups 1 start 2004-07-08 09:12:45 end 2004-07-12 10:13:13
• 41d https://datatracker.ietf.org/doc/draft-orly-atommib-rfc3895bis/history/ 01 dups 1 start 2006-08-14 11:14:47 end 2006-09-24 12:36:30
• 7d https://datatracker.ietf.org/doc/draft-ietf-tsvwg-emergency-rsvp/history/ 13 dups 1 start 2009-11-16 23:24:18 end 2009-11-24 01:05:31

[ietf-svn-bot]

@henrik@levkowetz.com changed status from new to closed

[ietf-svn-bot]

@henrik@levkowetz.com changed resolution from `` to fixed

[ietf-svn-bot]

@henrik@levkowetz.com commented

---

I've gone through these, cross-verified duplicates with draft dates, and deleted duplicates as needed. Closing this.

[ietf-svn-bot]

@henrik@levkowetz.com changed status from closed to deployed