UPDATE!I replaced the N80 Purge Valve and it fixed all the issues!
Car is now running healthy, drove it for few hours and no more Check Engine Light, misfire during idle is also gone. I also noticed a huge improvement in acceleration and overall responsiveness.
Here is the summary in case someone experienced this problem.
The problem-CEL is on with P0441 Code - EVAP Emission Control Sys - Incorrect Flow - MIL ON.
-Clearing the CEL is a temporary "solution", it will keep coming back.
-Occasional Engine Misfire at idle, more common and worse the less fuel you have in the tank (more air in the tank).
-Noticeable loss of power/laziness during acceleration.
Troubleshooting done-Checked n80 valve using VCDS basic test group 70 returns "EVAP Not OK"
-I tried swapping Ignition Coils and spark plugs to see if the misfire will move to a different cylinder(A common check to see if ignition coil/spark plug is the problem), nothing happened.
-Check for any leaks in the intake system and EVAP hoses, all OK.
-Checked PCV functionality. all OK.
Solution-First replaced the Charcoal Canister but it did not fix my issue, it is a possible solution.
-Replacing the N80 Purge Valve solves all the issues mentioned above.
Thanks everyone for the help!