Human Generated Data

Title

Photo Album
Date

c. 1857 - c. 1874
People
Classification

Photographs
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Transfer from Widener Library, Harvard University, 1978.484.64

Human Generated Data

Title

Photo Album

People
Date

c. 1857 - c. 1874

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.7
Human 99.7
Person 99.4
Person 99.4
Machine 66
Clothing 62.7
Apparel 62.7
Worker 62.1
Photography 58.8
Photo 58.8

Imagga
created on 2022-01-09

musical instrument 29
radio 20.9
man 18.8
old 18.8
percussion instrument 18.2
device 18.1
drum 17.5
people 17.3
male 15.6
person 14.2
broadcasting 13.6
stringed instrument 13
bass 12.9
work 12
outdoor 11.5
industry 11.1
industrial 10.9
travel 10.5
telecommunication 10.1
light 10
washboard 9.9
banjo 9.9
adult 9.8
interior 9.7
working 9.7
protection 9.1
jukebox 8.9
machine 8.6
color 8.3
silhouette 8.3
outdoors 8.2
danger 8.2
night 8
black 7.8
summer 7.7
chair 7.6
fun 7.5
sport 7.4
environment 7.4
home 7.2
holiday 7.2
record player 7.1
crutch 7.1

Google
created on 2022-01-09

Wood 82
Hat 80.4
Blue-collar worker 77.1
Vintage clothing 72.1
Stock photography 62.6
Monochrome 59.3
Working animal 57.8
Landscape 57.4
Soil 57.2
History 55
Visual arts 54.8

Microsoft
created on 2022-01-09

clothing 96.6
man 96.5
person 92.5
black and white 92
outdoor 92
musical instrument 78.6
old 74.7
white 65.1
text 63.9
monochrome 52.4
vintage 46.5

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 99.2%
Calm 97.9%
Sad 1.3%
Confused 0.4%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Male, 90.6%
Calm 99.5%
Sad 0.4%
Disgusted 0%
Happy 0%
Fear 0%
Surprised 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 22-30
Gender Male, 83.4%
Calm 83.2%
Sad 16%
Happy 0.4%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a vintage photo of a person 86.4%
a group of people in an old photo of a person 77%
a vintage photo of some people 76.9%