Preheat oven to 350 degrees. Butter a 9x13-inch baking dish.
In a large mixing bowl, whisk together egg yolks, milk, sweetened condensed milk, vanilla, ground nutmeg and kosher salt. Very gently fold in cubed King's Hawaiian sweet rolls, and pour the mixture into the buttered baking dish to absorb the liquid while the topping is prepared.
For the topping:
In a medium mixing bowl, whisk together the flour, brown sugar and cinnamon. Cut the butter into the mixture with a fork or pastry cutter until crumbly. Stir in the chopped pecans.
Sprinkle the topping over the bread mixture and spread it out evenly.
Bake at 350 degrees for 45-50 minutes, until the center is set.
Cool and serve warm. If desired, garnish with maple syrup and fresh fruit.