What does the swarf look like? big or small flakes, shavings? Could it be off your sprocket cover or swingarm?

Wish I was closer to have a look at this... :-/