To raised understand this point, we now bring theoretical information. As to what comes after, i first design brand new ID and you will OOD data distributions and derive mathematically the new model output from invariant classifier, where in fact the design tries to not ever have confidence in environmentally friendly have to own prediction.
Settings.
We consider a binary classification task where y ? < ?>, and is drawn according to a fixed probability ? : = P ( y = 1 ) . We assume both the invariant features z inv and environmental features z e are drawn from Gaussian distributions:
? inv and you may ? 2 inv are exactly the same for everyone environments. On the other hand, the environmental variables ? e and you may ? 2 e differ around the elizabeth , in which the subscript can be used to point the fresh new need for new ecosystem while the directory of ecosystem. As to what observe, we introduce the results, having outlined research deferred from the Appendix.
Lemma step one
? e ( x ) = M inv z inv + Yards e z elizabeth , the perfect linear classifier to have a host elizabeth provides the relevant coefficient 2 ? ? step 1 ? ? ? , where:
Note that brand new Bayes optimal classifier spends environment have which are informative of name however, non-invariant. As an alternative, hopefully so you can count simply toward invariant has whenever you are ignoring environmental has. Such as for instance an excellent predictor is also described as max invariant predictor [ rosenfeld2020risks ] , that bristlr recenzja is specified in the pursuing the. Observe that this might be a separate matter of Lemma step 1 having Yards inv = I and you can Yards e = 0 .
Suggestion step 1
(Maximum invariant classifier having fun with invariant keeps) Suppose the latest featurizer recovers the invariant feature ? age ( x ) = [ z inv ] ? Continue reading Considering the performance significantly more than, an organic concern appears: exactly why is it difficult to choose spurious OOD inputs?