Human Generated Data

Title

Untitled (portrait of a couple and their son)

Date

c. 1930

People

Artist: Curtis Studio, American active 1891 - 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1254

Human Generated Data

Title

Untitled (portrait of a couple and their son)

People

Artist: Curtis Studio, American active 1891 - 1935

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 98.8
Person 96.2
Apparel 93
Clothing 93
Art 86.8
Painting 86.8
People 83.7
Overcoat 76.4
Coat 76.4
Tie 71.7
Accessory 71.7
Accessories 71.7
Text 65.9
Suit 61.8
Family 57.5

Imagga
created on 2022-01-23

man 51
male 44
person 39.2
suit 37.1
clothing 32.3
portrait 30.4
bow tie 28.5
necktie 28.2
adult 27.9
people 26.2
businessman 25.6
black 25
business 24.3
handsome 23.2
tie 21.8
military uniform 19
face 17.7
success 16.9
guy 16.4
men 16.3
garment 15.8
uniform 15.6
covering 15.5
human 15
expression 14.5
professional 13.9
jacket 13.6
fashion 13.6
consumer goods 13.3
attractive 13.3
executive 13.1
couple 13.1
elegant 12.8
smile 12.8
happiness 12.5
happy 12.5
style 11.9
shirt 11.3
standing 11.3
looking 11.2
one 11.2
love 11
confident 10.9
model 10.9
smiling 10.8
hand 10.6
hair 10.3
hat 10.3
mature 10.2
dark 10
pose 10
studio 9.9
mortarboard 9.8
office 9.6
formal 9.5
serious 9.5
corporate 9.4
senior 9.4
gown 9.2
old 9.1
dress 9
family 8.9
sexy 8.8
boss 8.6
cap 8.5
modern 8.4
elegance 8.4
holding 8.2
single 8.2
posing 8
job 8
lifestyle 7.9
player 7.8
worker 7.8
confidence 7.7
wearing 7.6
head 7.6
relationship 7.5
manager 7.4
performer 7.3
cheerful 7.3
alone 7.3
academic gown 7.3
romantic 7.1

Google
created on 2022-01-23

Sleeve 84.8
Collar 76.3
Classic 74.9
Vintage clothing 73.5
Art 72
Formal wear 71
Event 65.5
Monochrome 62.4
Suit 61.4
History 60.4
Retro style 55.2
Portrait 53.9
Visual arts 51.9
Blazer 51.8
Sitting 51.6

Microsoft
created on 2022-01-23

person 96.4
clothing 95.7
text 92.9
old 91.8
smile 84.9
man 83.5
human face 80.3
black 79.3
suit 57.3
posing 48.6
image 40.7
vintage 25.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-45
Gender Male, 100%
Calm 97.2%
Angry 1.2%
Confused 0.6%
Surprised 0.4%
Happy 0.2%
Disgusted 0.2%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 2-8
Gender Male, 99.9%
Calm 89.1%
Sad 10.5%
Angry 0.1%
Confused 0.1%
Fear 0%
Disgusted 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 29-39
Gender Female, 100%
Calm 84.5%
Sad 5.1%
Confused 3.3%
Angry 2.5%
Fear 1.5%
Disgusted 1.3%
Surprised 1%
Happy 0.8%

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Painting 86.8%
Tie 71.7%

Captions

Microsoft

a vintage photo of Kazimir Malevich et al. posing for the camera 91%
a vintage photo of Kazimir Malevich et al. posing for a picture 90.9%
an old photo of Kazimir Malevich et al. posing for the camera 90.3%