Human Generated Data

Title

Untitled (full-length portrait of standing boy and seated girl in front of painted backdrop depicting a room interior)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13902

Human Generated Data

Title

Untitled (full-length portrait of standing boy and seated girl in front of painted backdrop depicting a room interior)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Apparel 99.8
Clothing 99.8
Human 99
Person 99
Person 98.4
Shoe 91.6
Footwear 91.6
People 80.2
Shoe 78.4
Furniture 73.4
Coat 67.1
Hat 63.6
Sitting 57.4
Photography 57.1
Photo 57.1
Boot 56.1

Imagga
created on 2022-01-28

military uniform 100
uniform 100
clothing 79.1
covering 52.5
consumer goods 52.2
man 33.6
people 29
commodity 25.8
male 24.8
adult 22.3
person 22
portrait 18.1
happy 17.5
home 15.2
family 14.2
face 14.2
old 13.9
attractive 13.3
senior 13.1
couple 13.1
lifestyle 13
two 11.9
room 11.6
smile 11.4
human 11.2
casual 11
happiness 11
playing 10.9
black 10.8
fun 10.5
business 10.3
mature 10.2
dress 9.9
child 9.8
fashion 9.8
interior 9.7
indoors 9.7
office 9.6
elderly 9.6
love 9.5
innocent 9.4
mother 9.3
school 9.2
alone 9.1
aged 9.1
job 8.8
businessman 8.8
medical 8.8
smiling 8.7
men 8.6
gun 8.4
health 8.3
vintage 8.3
occupation 8.2
to 8
women 7.9
together 7.9
boy 7.8
standing 7.8
soldier 7.8
army 7.8
military 7.7
pretty 7.7
illness 7.6
professional 7.5
relationship 7.5
one 7.5
cheerful 7.3
lady 7.3
looking 7.2
hair 7.1
handsome 7.1
kid 7.1
work 7.1

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 99.3
person 99
clothing 98.8
human face 96.2
posing 90.6
smile 78.4
old 77.8
child 74.3
white 61.9
toddler 57.8
woman 51.3
dressed 30

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Male, 99.9%
Calm 62.7%
Sad 27.8%
Angry 8.2%
Confused 0.5%
Happy 0.3%
Fear 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 6-12
Gender Female, 100%
Calm 91.8%
Sad 5.4%
Confused 0.9%
Angry 0.8%
Fear 0.4%
Surprised 0.3%
Disgusted 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Shoe 91.6%

Captions

Microsoft

a vintage photo of a man and woman posing for a picture 93.7%
a vintage photo of a man and a woman posing for a picture 93.6%
a vintage photo of a man and woman posing for the camera 92.2%