Human Generated Data

Title

Untitled (studio portrait of couple with three sons in Boy Scout uniforms)

Date

c. 1930-1945

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10944

Human Generated Data

Title

Untitled (studio portrait of couple with three sons in Boy Scout uniforms)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1930-1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Human 99.6
Person 99.6
Person 99.1
Person 99
Person 98.9
Clothing 93.4
Apparel 93.4
Person 92.9
Footwear 92.6
Shoe 92.6
People 92.2
Shorts 79.2
Shoe 73.1
Shoe 71.5
Helmet 71.4
Costume 71.1
Face 64.3
Military 61.4
Military Uniform 61.4
Sphere 59.9
Crowd 59.6

Imagga
created on 2022-02-05

people 22.3
person 20.5
black 19.8
brass 19.6
wind instrument 18.3
lady 17
human 16.5
adult 16.4
sexy 16
clothing 15.8
maillot 15.6
male 15.6
style 15.6
body 15.2
fashion 15.1
man 14.9
portrait 14.2
model 14
sax 13.9
swimsuit 13.7
silhouette 13.2
men 12.9
attractive 12.6
garment 12
dress 11.7
musical instrument 11.7
group 11.3
love 11
bride 10.7
pretty 10.5
art 10.5
film 10.3
light 10
dance 10
vintage 9.9
women 9.5
party 9.4
cornet 9.3
music 9.3
old 9.1
retro 9
planner 8.9
happy 8.8
outfit 8.7
hair 8.7
couple 8.7
happiness 8.6
sitting 8.6
business 8.5
negative 8.3
dancer 8.3
kin 8.2
water 8
covering 8
design 7.9
standing 7.8
sepia 7.8
elegant 7.7
crowd 7.7
grunge 7.7
hand 7.6
elegance 7.6
wedding 7.4
pose 7.2
businessman 7.1

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

text 99.5
person 98.4
clothing 93.6
posing 86.8
man 75.1
old 66.4
smile 54.2

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 100%
Happy 94.1%
Calm 3.1%
Fear 1.2%
Disgusted 0.8%
Surprised 0.3%
Sad 0.2%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 25-35
Gender Male, 100%
Happy 42.4%
Surprised 35.7%
Calm 13.8%
Sad 3%
Fear 1.9%
Disgusted 1.4%
Angry 1.2%
Confused 0.5%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Surprised 39.9%
Happy 28.2%
Calm 18%
Fear 4.5%
Angry 3.1%
Sad 2.7%
Disgusted 2.3%
Confused 1.3%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 89.5%
Sad 3%
Surprised 1.8%
Happy 1.6%
Disgusted 1.3%
Confused 1.3%
Angry 1%
Fear 0.4%

AWS Rekognition

Age 28-38
Gender Male, 100%
Surprised 47.1%
Calm 18.2%
Fear 11.2%
Sad 10.3%
Disgusted 3.7%
Confused 3.5%
Angry 3%
Happy 2.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 92.6%
Helmet 71.4%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 94.1%
a vintage photo of a group of people posing for a picture 94%
a group of people posing for a photo 93.9%

Text analysis

Amazon

157