Boil potato halves until cooked through, about 15-20 minutes depending on the size of the potatoes. Let cool completely. Set 2 potatoes aside, and slice the rest in half.
Scoop out the inside of the potato halves, leaving a thin shell. Be careful not to remove too much. Put the potato you scoop out into a bowl. Chop the remaining 2 potatoes and add it to the bowl.
Add the mayonnaise, mustard, pickles, pickle juice, salt, and pepper to the bowl. Stir to combine. Once fully mixed, chop the eggs and add them to the bowl. Fold the eggs in, being careful not to mash them. Taste the mixture and adjust the seasoning to your liking.