Akstens, In your case, a top mount refrigerator, the cold control, in the refrigerator compartment controls the temperature. It is not a "baffle", air from the freezer compartment "drops"' down into the air damper, where the end of the temperature control is located, and control cycles the compressor on and off as needed, based on the air temperature in the damper.
Most cold controls are preset to deliver 38 dgrs.F(+/- 2 dgrs.) when set at the recommended (mid way) settings. The freezer is 0 dgrs.(+/- 2 dgrs) when set. The product temperature in the compartments are usually 2 to 3 dgrs. lower than the air temperature after 24 to 48 hours.When you are making adjustments to the temperature controls, you have to wait 24 hours between settings, to allow for the temperature to equalize.
You may want to reset the controls , wait 24 hours and check the product temps with a pocket thermometer ( a can of soda, jar of pickles, etc.and a bag of frozen vegetables works well in the freezer).Then adjust the control, and wait 24 hours, and recheck the temps. recheck the temperature in a few days, If the temperatures were not maintained, then call the servicer.

Akstens, Correct, The refrigerator temperature control is the "main" control and runs the compressor.The dial in the freezer controls a "flap" inside the air tunnel which increases or decreases the air flow into the freezer compartment. Just remember, the colder the freezer, the less air movement to the refrigerator.
As you said, the damper is a "passive fixed thing", there are no dampers or doors, etc. The damper consists of a styrofoam block with directional openings to disperse the air in different directions throughout the refrigerator compartment.