BB+ wrote:Furthermore, it is arguable that the ICGA's actions did in fact suffice for any right-to-be-heard of Rajlich's regarding disqualification, and perhaps the EC considered this.
syzygy wrote:That is arguable, but I don't think it is possible to read the judgment like that ... I'll admit that the judgment does not state that Rajlich was not given the right to be heard as regards the alleged rule 2 violation, but that is because it is silent on that point.
The following phrase could be taken to indicate that the EC felt that Rajlich was sufficiently informed of the possibility of disqualification:
One person who is informed that his behaviour could be qualified as a cheating and sanctioned with a lifetime ban is likely to assume different decisions about his defence, in comparison to a person who just know about the risk to be disqualified from a tournament. I wouldn't think they would just be making an abstract comparison, but they indeed might (a few lines previous it talks of the "very informal way" that Rajlich was informed for instance). I'm not sure what other elements of a right to be heard are at issue? Unless you are putting impartiality under this heading?
"For any decision concerning a violation of their tournament rules, ICGA has not to respect a given model of procedural rules (...)." "Exactly as a chief arbiter or a TD (...)." "an Investigation panel (that has not to be necessarily independent)."
Contrariwise, while the EC stresses that the ICGA didn't
have to follow any particular procedure, at the same time I don't think it passes any specific judgement on the procedure the ICGA chose, in particular whether it sufficed for a right to be heard and/or for (subsidiary) impartiality. Perhaps they are taking the easy way out (again), and ruling on essentially a formal matter rather than a substantive one.
What the EC will do in an extreme case is difficult to predict, but if this judgment is anything to go by, they will accept it.
It could be my personal bias, but I think the presentations in this case tended to diminish Rajlich's prospects (already the
complaint is rather fitful, without even seeing Levy's response). Even when there is viable content, it does not particularly impress. For instance on page 4, given as "in his own words" we read:
It was clear that the ICGA had no intention of handling things in a fair manner. They made loud and unnecessary public accusations. They put vocal Rybka critics in charge. They did not investigate any other engines. And so on. However, none of these statements (particularly the last!) are expanded much except for the third (which by implication relates to the first, but does not make it "clear" IMO). There is no citation of such "loud and unnecessary public accusations (by the ICGA)", and similarly no reason is given why the ICGA should investigate any other engines (without a formal complaint). The makeup of the Panel (particularly the Secretariat) is discussed at length, but the EC seems to have agreed that as it was properly advisory, and that as Rajlich was allowed to respond to its conclusions and recommendations, this sufficed for "impartiality" to be met.
Note that 3 of the 5 EC members were jurists/lawyers, while the other two were not AFAIK (such a mix might well be wise in this type of body), and the latter would be more likely to state their opinions by impressions and let the others sort out the technical details. What is one to think of the overwrought grandiloquence of 4.3?: "This act of shocking lawlessness" and
Apparently the ICGA believes that it is the supreme ruling body of computer chess, and that its actions and decrees are the final word on all matters related to computer chess. We do not recognize the ICGA as such a body and wonder from where such outlandish pretensions derive their legitimacy. It is hard to see how this would make a good impression. Similarly in the 2013
emendation regarding the purported "right to an appeal", Schröder's cited correspondence (as Rajlich's
carte blanche representative) tends to the vexatious by the end.
The ICGA Board had to decide on the basis of the panel's report.
It might be said that this was particularly true when Rajlich chose not to offer an alternative defense
... But I would also say that the Board
could have taken a different tack, decided that the Panel had gotten out of hand, etc. Unlikely for sure, but they did not "have" to decide based on the report, particularly in any formal sense (as a judge would have to rule on evidence). Also, Levy makes the point in the ChessBase interview that the Board decision was based on both the Panel report
and on the evidence that underlied it (re-reading this, I also find that he cites Article III Section 1 as a basis of sanctions: the Executive Committee of the ICGA is charged with the administrative affairs of the association).
Note that the content of the report is not readily verifiable and the ICGA Board in any case lacked the expertise to verify the technical facts asserted.
How is it not verifiable? The members of the Board had full access to the investigation wiki, from which the report contents came. And regarding the second statement, I don't think it is particularly true, unless you mean that the Board is formally supposed to pretend that it lacks any technical capacity, and only go on the arguments given?
Vas could not appoint a counter-panel to produce a counter-report, let alone one on the same footing as the "official" panel report, so the panel should have been independent to preserve equality of arms. Advisory bodies in quasi-judicial procedures are usually required to be independent. ... Anyway, yes, lack of independence of the panel taints the evidence (= panel report) that formed the basis for the ICGA Executive Committee's decision.
So would the only way for the ICGA to meet any requirement herein be to find a pre-existent outside body to which both sides were agreeable? This would seem quite a high bar of expectation (particularly if the ICGA had to foot any costs), and so perhaps "this is not a trial" is a better model, allowing Rajlich a right to respond to any report (and/or take part in the investigation that would produce the report). My memory is quite clear that Rajlich (after the verdict, in the context of having someone independently review it) specifically said something along the lines of "Appointing someone 'independent' doesn't mean much when you get to choose who it is."
At any rate, I would agree that Levy's initial plan with the Panel, that both sides would join it and come to a meeting-of-minds (regarding technical matters), greatly backfired in the end, and that after Rajlich decided not to join therein, it would have been better to re-position it as something closer to prosecutorial rather than merely "investigative". But again, once Rajlich is negative toward the panel idea (in general), what exactly could the ICGA do so as to ensure independence and/or equality of arms? Maybe "decertify" the investigation panel from being "official" and let Letouzey (say, or his designate) form such a group on his own, which would then "have standing" to present the evidence to the Board? [At that point, it would be hard to construe it as being merely "expert advice" anymore (cf. Rule #2 and EC procedural interpretation therein), rather it would be notably advocatory].
Advisory bodies in quasi-judicial procedures are usually required to be independent. Same for expert witnesses.
Taken to the absurd, could you then argue that the "seeking expert advice" in Rule #2 should thus mean an
independent expert [to the extent considered above]?
I don't really see any way to construe this phrase other than "an expert as chosen by the ICGA", and don't see why post-tournament this should change to be qualified as "independent expert advice" (and I as say, adding the word "independent" would probably just transfer the squabbles to be over what it means, either in a quasi-judicial or procedural sense). Incidentally, I ran across a laughable "expert witness" dispute (about linear combinations) yesterday, see page 6 and 7 (Section C) of
this.
(The report did contain subjective views on Rybka 3 and I'm afraid even an analysis of Rajlich's character, but those views should have been left out and should have been ignored by the ICGA Executive Board. Expert advice should not take the form of "I have reasons not to trust that guy, so he is guilty".)
I think you are somewhat back-fitting the EC term (borrowed from rule 2) of "expert advice" to the Panel report/procedure, and in a rather
en masse manner. But a different interpretation could be that
parts of the Report were indeed "expert advice", and others were, well, assorted fluff (at best). I have no knowledge of what was considered or ignored by the ICGA executive.
Of course the panel could not help that the ICGA Executive Board even went beyond the facts established by the panel. The panel did not establish any facts regarding Rybka 3, for example.
I think in a Panel discussion it was discussed whether the 2008-10 entries could adequately be modelled by Rybka 3 and 4, and the (only?) opinion on the matter was that this was not yet warranted. And as in the previous comment, I think that taking the Report as presenting "facts established by the panel" (as an expert witness) is a bit too much of trying to shoehorn it into some more typical procedural framework. [To put it more crudely: You probably can't try to retroactively make sense of the ICGA procedure as seen by the EC vis-a-vis Rule #2, unless you accept a few misgivings and work by rather loose analogy at some points].
Anyway, I might as well (for better or worse) quote what Levy said about later Rybka entries:
The ICGA has not done extensive analysis of newer versions of Rybka. It was sufficient for the ICGA to determine that Rajlich had broken Tournament Rule 2, which we did. When the ICGA chose to ban Rybka for life due to violating the rules in ICGA events in 2006 and 2007, this required all of Rajlich's programs be removed, since the newer programs would never have been allowed to compete if the violation of earlier versions was discovered sooner and the lifetime ban issued earlier. So while it is possible that newer versions of Rybka also contained Fruit-derived code, it was not essential to prove this once we had proved the case for the 2006 and 2007 ICGA tournaments. Note that the language he uses could be taken to make the 2008-10 removals conditional on the lifetime ban having been retroactively assessed starting in 2007.
[Fortunately, FIDE could led them off the hook again, by allowing a 3-year ban under then-applicable CoE sanctions, conveniently lasting through his final appearance in 2010].
The panel recommendation should not have included any suggestion on the sanction or penalty to be imposed, at least not if the panel is supposed to exist for the purpose of giving expert advice on technical issues. I accept there is also an element of "programmer's ethics", so I guess it is OK to give a view on the severity of the rule infraction, but such views should not suggest any sanctions. (And of course Rule 2 is pretty clear anyway on what the possible sanction could be.)
Although I would agree that the Panel acting
qua "expert advisor on technical matters" could be circumspected in this scope, again I refer to the previous paragraphs (concerning what the Panel is/was/ought-to-be/perhaps-could-be-considered-as), and also note that the Charter states that recommendations of actions are part of the Panel's purpose:
The purpose of the Panel shall be to:
(c) Make recommendations to the ICGA as to what action if any should be taken against those found by the
Panel to have been guilty of cloning or creating a derivative;
That refusal [to join the panel] was then used against him, which in my view is completely unjustified.
I don't remember specifically this refusal being used against him? I don't think the EC complaint specifies anything about this. I could find 3 possible "uses" of his refusal against him.
- In the Panel report section "Opinion of panel members": Dailey and Uniacke show rather severe annoyance (at the ethical level) about his refusal to address the allegations, as does Skinner to a lesser degree. [The refusal is also mentioned in the procedural history (1.3) of the report].
- Levy email of May 13: Up to now you have not responded positively to my invitations to respond to the various allegations that have been made against you during the course of this investigation.
- in the verdict: During the course of the investigation and upon presentation of the Secretariat’s report Vasik Rajlich did not offer, despite repeated invitations from the ICGA to do so, any kind of defence to the allegations, or to the evidence, or to the Secretariat’s report...
Only the first seems to me to be of notable content as possibly "being used against him" to any degree, though the other two do take a certain tone toward the matter. If you could show a demonstrative link between the Panel comments (regarding refusal) and anything that later ensued, I would say your view might be more justified. But I would think it more to be a "minor influence" at best.
When was Rajlich asked to prove his innocence for all his entries? When did he refuse to do so?
[I suspect the context is the word
all here --- also, the prior postings had some contextual confusion with "issues being raised" (to the EC?), versus the specific issue of the 2008-10 entries not being examined]. Of course it won't meet the strictest juridical protocols, but the May 13
email could be taken to meet the first request in that it subjoins and articulates the Panel Report (asking him to respond it), particularly "pleas for mitigation", presumably against the report Recommendation of stripping him of "all ICGA Tournament titles" -- the subsequent lack of responses could then suffice for the latter. [It probably depends on how the judge feels toward the disputants as to how far this can be stretched]. As noted above, Levy's comments could be taken to imply that the "lifetime ban" started in 2007 and so already wiped out 2008-10 (of course, just because Levy might imply something in an interview, that doesn't mean it is the official ICGA position -- in particular, the verdict proposed an alternative schema, namely that Rajlich had indeed broken Rule #2 in all 5 WCCC appearances).
And how could he have done it [showing cause for his 2008-10 entries], except by opening up his code to his worst enemies?
I didn't know that Ken Thompson was one of his worst enemies.
[And since KT was suggested by the ICGA, he obviously would not be "independent" to a sufficient degree!]. I remember back in 2008 (if you recall, there was some talk of a complaint about Rybka being filed at the WCCC that year), that Harvey Williamson was quite
clear that he as the Hiarcs operator would
not have access to the source code if a complaint was made against him, and that there were comments in this regard that the commercial guys would probably have to just lump it and endure disqualification if a complaint (deemed acceptable to the ICGA) was made. It's obviously a trade-off that must be given some weight, particularly when the possibility of complaints is more than just hypothetical. [Somehow using the phrase "occupational hazard" doesn't sound right, but might be an analogy].
In the end he was given one month to reply during a time in which he was very busy. After so many years, would it have been too much to delay by a few more months?
I would agree with Levy that Rajlich is
not the one who chooses the dates of hearings, but also agree with you that some delay (maybe one month, given specific grounds for it) would be acceptable in the situation. Certainly all the forums were wondering at the time what was taking so long (indeed, about 2 months after the Panel convened there was some Rybka Forum comments about Rajlich having the right to receive a report from the ICGA in due time, and not have them drag this out forever, and with Vas's name having been smeared by the accusations thus time was of the essence, blahblah), but the ICGA presumably shouldn't let itself be moved by that. I don't think being "very busy" (the phrase was
schedule is very full for the next 7 months) matters much, eg the EC only gives you 21 days (though Short did request and receive an extension back in 2007, as he was travelling a lot). And sometimes you have to make some [hopefully minor] re-arrangements in your life to address matters like this (also he should consider it taking away from his "free time", not "work time" as I infer from "schedule"). If his wife had just given birth, or he was finalising a cluster-cloud contract with ChessBase, etc., sure give him some time, but 7 months for a "very full" schedule?!
Another argument would be that he had known the essence of these allegations for some time, and it's not clear exactly what giving extra time would really gain for him (other than as a delaying tactic), certainly without himself specifying anything in particular. How long should it take to construct a defense to the main claims (ignore Rybka/Crafty for now)?
- Nearly the entire evaluation function (of Rybka) is derived from Fruit
- In summary, the evaluation functions are nearly identical
- Rybka 1.0 Beta and Fruit 2.1 have exactly the same evaluation features (preliminary finding)
- Comparison of evaluation features shows high similarity of Rybka (including 2.3.2a) and Fruit
Rajlich could presumably dispute either: (1) the contention that Rybka and Fruit have similar evaluations is erroneous (possibly because the studied Rybka versions are irrelevant to this discussion), (2) they are similar, but it is not out of the ordinary, (3) they have extraordinary similarities but this is not prohibited by the rules. His correspondence with Levy suggests that he would argue #2 (via ponderhit data, which Levy noted was only marginally operative) and #3 (
I'd say that Rybka is in compliance with these rules, although some of the terms are kind of vague and
The vague phrase "derived from game-playing code written by others" also does not in my view apply to Rybka). I would guess giving Rajlich an extra month to determine how best to convince the ICGA that its "vague" rules should not be applied to him would have largely been wasted. [Although I agree that Rule #2 is not the clearest in the world, Levy in his ICGA Journal comment pointed out that Rajlich was personally present in Turin 2006 and saw/heard the debate over the LION++ disqualification, and so at the very least should have known he was treading on thin ice, and perhaps asked for a clarification].
(Why does the "recommendation" make a point of the entry forms not mentioning that earlier versions, that everybody agrees never competed in ICGA tournaments and had little if anything in common with the "real" Rybka, included code from Crafty? A program that was in fact recommended by Hyatt to use as a starting point that one could eventually evolve into something that is "yours".)
Maybe by now "everybody agrees" that early Rybka has "little if anything in common" with the competition versions, but in 2011 it was a different story, and Rajlich had made statements which could be taken to imply the contrary. See the previous page in the report (Rajlich has not disputed this email to ZW, as far as I know):
Rybka started as a bitboard/MTD(f)/UCI engine back in March 2003. Everything I did after that, until today, has been incremental - although there were some pretty sharp turns. I can't imagine ever ditching my code base. Similarly one could be misled by his 2005 forum posting:
The Rybka source code is original and pre-dates all of the Fruit releases (this was not quoted in the report). Perhaps any point that was being made in the Recommendation (as a parenthetical remark) should be taken as a contingency, in case Rajlich tried to elaborate on such putative Rybka provenance.
He was invited to a panel in lynch mode
Well, I guess our conversation here is deteroriating. Even the complaint only terms it
a panel pre-conceived of his guilt. On a different topic, I might say that 2. a4 is looking reasonable (I am tired of sluggish progress [if any at all] with Ba6, and so am looking elsewhere), but still very very preliminary.