Start by heating the oil in a large saucepan. Add the onion and celery and cook until softened.
Add the cubed potatoes and put enough water in the saucepan, just to cover the potatoes. Bring to a boil and then reduce the heat to medium low and let the potatoes simmer, stirring frequently. Keep stirring and simmering until the potatoes are completely softened.
Season with salt and pepper and add the evaporated milk, continuing to stir until milk is heated all the way through.
Place in bowls and sprinkle with crumbled bacon. Serve with bread, salad or just enjoy it on its own.