PCGrad

class torchjd.aggregation.PCGrad

GramianWeightedAggregator as defined in Algorithm 1 of Gradient Surgery for Multi-Task Learning.

__call__(*args, **kwargs)

Computes the aggregation from the input matrix and applies all registered hooks.

Parameters:

matrix – The Jacobian to aggregate.

Return type:

Any

class torchjd.aggregation.PCGradWeighting

Weighting [PSDMatrix] giving the weights of PCGrad.

__call__(*args, **kwargs)

Computes the vector of weights from the input Gramian and applies all registered hooks.

Parameters:

gramian – The Gramian from which the weights must be extracted.

Return type:

Any