Kody Brown Makes a Decision About Finding New Wife

Kody Brown is making a big decision.

As season 20 of Sister Wives kicked off on Sunday, Sept. 28, Kody had a candid conversation with his wife, Robyn Brown, about the possibility of becoming polygamists again. The discussion occurred during a restaurant date, where Kody brought up how a relative asked Robyn if they were still in a plural marriage.

At this point, Kody’s marriages to Christine Brown, Meri Brown and Janelle Brown have already imploded. Robyn, whom he spiritually wed in 2010 before legally marrying her in 2014, is now the Special Forces star’s only wife.

“I wasn’t quite sure what to say to him,” Robyn, 46, admitted. “I didn’t want to speak for you. I feel like if this is still something that’s a part of me, then wouldn’t I live it?”

Kody, 56, then noted that Robyn had previously “turned down qualified, worthy individuals for marriage because they weren’t going to live plural marriage” prior to meeting him. “If I’d have been pursuing you and I didn’t have other wives, how would you have treated it?” he then asked.

“I would have said the same thing to you,” she confessed.

Because of that, Kody asked if she saw “a value” in continuing to live as polygamists and if she thought it was beneficial to the “future” of their own relationship.

But before her response was even shown, Kody said separately to the cameras: “I don’t know what space Robyn is in, and I don’t know what space we’ll be in in two or three years. I almost feel like turning the table and saying, ‘Well, do you want to get back in plural marriage?'”

Robyn, in responding, said that if “there was somebody who was really supportive and really wanted to work and really wanted a relationship with me as well as with you, not just you, and then we had a guarantee that it was going to be OK and it was going to be wonderful and it was going to be what I always dreamed it was supposed to be,” then she would consider plural marriage again more seriously.

“That would be something to really, truly consider,” Robyn said.

“I think you and I share something very special,” Kody replied. “But if it’s not duplicatable, it could put us at risk. … There’s something wonderful here. Why would we put that at risk?”

In agreeing with him on that front, Robyn noted that it wouldn’t be worth the risk unless they had “a guarantee.” To that, Kody pointed out that there is “not a guarantee.” However, Kody also laid out one possible reason to resume polygamy: “There’s something I want maybe more than you do.”

He was referring to sexual intimacy. “My primary motivation, I’m afraid at this state in my life, would be … yeah, just how good looking she is,” he explained, resulting in a chuckle from his wife. “I’m not kidding.”

“And that would be the very worst reason,” Robyn said, noting that Kody didn’t “understand how [he was] coming across.”

“I know. I’m a guy and I don’t freaking care,” Kody bluntly stated.

Kody, however, still indicated that sex “wasn’t a good enough reason” to put their marriage at risk, and Robyn agreed.

“I’m getting really honest with you here. Just take the sex out completely,” Kody then began to share in a confessional. “She would have to adore Robyn so much that I would never, ever have to worry about whether she was competing with Robyn for my love and affection.”

Back to their conversation, Kody and Robyn discussed the logistics of it all, especially since they’re “not involved in [the] religion anymore” and it “would be a requirement.”

“I’m just not interested in having the drama in my life of another woman,” Kody shared.

“Are you and I enduring our marriage?” Kody continued. “I mean, we have our bad days, you know. Our murder face comes out, and it’s like, ‘Stop that!’ You’re OK knowing that all the attention I need …”

Kody then made a jab at his three ex-wives, saying, “Those sister witches of yours…” But Robyn playfully called him out on that before asking if he’d be her “cheerleader,” to which he said he’s “rooting” for her.

The PEOPLE Puzzler crossword is here! How quickly can you solve it? Play now!

“Then, we’re great!” added Robyn.

Noting that he was “done” with polygamy, Kody said that “the idea of it just breaks my heart.”

“So, it’s you and me, baby. Monogamy, does it work for you? Will it work for you?” Kody asked as Robyn answered, “Sounds good. … It sounds good, I’m good.”

And with that, Kody said, “OK, it’s a deal,” before they ended the exchange with a kiss.

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

Sister Wives airs Sundays at 10 p.m. ET on TLC.