Human Generated Data

Title

Untitled (studio portrait of couple wearing corsages)

Date

1941

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10243

Human Generated Data

Title

Untitled (studio portrait of couple wearing corsages)

People

Artist: Martin Schweig, American 20th century

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.6
Human 99.6
Person 99.4
Military Uniform 90.3
Military 90.3
Apparel 89.2
Clothing 89.2
Face 81.9
Suit 71.6
Overcoat 71.6
Coat 71.6
Flower 70.5
Plant 70.5
Blossom 70.5
Robe 61.9
Fashion 61.9
People 60.6
Armored 59.9
Army 59.9
Finger 58.3
Gown 56.4
Officer 56
Performer 56
Soldier 55.8

Imagga
created on 2022-01-22

groom 68.9
couple 44.5
man 44.4
bow tie 40.5
male 36.4
happy 35.8
love 34.8
smiling 31.1
necktie 29.1
people 29
portrait 28.5
adult 28.5
person 27.7
mother 25
married 23
smile 22.8
suit 22.7
family 22.3
senior 21.6
husband 21.5
happiness 19.6
two 19.5
together 19.3
men 18.9
handsome 18.7
parent 18.5
wedding 18.4
bride 17.3
romance 17
marriage 16.2
attractive 16.1
businessman 15.9
mature 15.8
dress 15.4
business 15.2
wife 15.2
executive 14.8
garment 14.8
cheerful 14.6
tie 14.2
grandma 13.9
romantic 13.4
pretty 13.3
lifestyle 13
hair 12.7
affection 12.6
old 12.6
elderly 12.5
boy 12.2
standing 12.2
face 12.1
office 12.1
holding 11.6
pair 11.3
relationship 11.3
confident 10.9
father 10.9
fan 10.8
affectionate 10.7
fashion 10.6
lady 10.6
fun 10.5
looking 10.4
corporate 10.3
expression 10.2
casual 10.2
darling 9.7
group 9.7
celebration 9.6
adults 9.5
grandfather 9.4
child 9.1
daughter 8.8
home 8.8
follower 8.8
boyfriend 8.7
clothing 8.7
day 8.6
loving 8.6
laughing 8.5
togetherness 8.5
bouquet 8.5
meeting 8.5
professional 8.4
success 8.1
women 7.9
look 7.9
grandmother 7.8
bridal 7.8
retired 7.8
sitting 7.7
jacket 7.7
30s 7.7
laugh 7.7
formal 7.6
joy 7.5
kin 7.5
glasses 7.4
successful 7.3
sexy 7.2

Google
created on 2022-01-22

Smile 91.5
Coat 87.6
Flower 86.1
Gesture 85.3
Happy 83.3
Tie 79.1
Formal wear 76.3
Suit 73.3
Event 73.3
Vintage clothing 72.5
Handwriting 71
Plant 70.1
Art 68
Jewellery 67.9
Classic 67.7
Monochrome photography 66.3
Necklace 65.7
Monochrome 63.8
Stock photography 63.3
Room 63.2

Microsoft
created on 2022-01-22

text 99.6
wall 99.4
person 98.6
human face 96.8
indoor 93.5
smile 90.9
posing 85.8
clothing 80.1
portrait 58.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Female, 100%
Happy 33.8%
Surprised 30%
Sad 21.2%
Confused 5.1%
Disgusted 4.1%
Calm 2.4%
Fear 1.9%
Angry 1.5%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 93.7%
Confused 4.2%
Surprised 1.2%
Angry 0.5%
Fear 0.1%
Happy 0.1%
Disgusted 0.1%
Sad 0.1%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Suit 71.6%

Captions

Microsoft

a group of people posing for a photo 94.6%
a group of people posing for the camera 94.5%
a man and woman posing for a photo 86.7%

Text analysis

Amazon

PROOF
SAINT
SAINT LOUIS
LOUIS
MARTIN
MARTIN SCHWEIG
SCHWEIG
put
put eyelaskis
eyelaskis

Google

PROOF
SCHWEIG
MARTIN
SAINT
PROOF MARTIN SCHWEIG SAINT LOUIS
LOUIS