Human Generated Data

Title

Untitled (Jats, Hindus, Delhi)

Date

1862-1863

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. R. Minturn Sedgwick in memory of R. Minturn Sedgwick, Class of 1921, P1981.57

Human Generated Data

Title

Untitled (Jats, Hindus, Delhi)

People

Artist: Charles Shepherd and Arthur Robertson, British, English in partnership c. 1862-1863

Date

1862-1863

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.9
Human 99.9
Person 99.7
Person 99.6
Person 98.5
Clothing 98
Apparel 98
Sitting 84.5
People 78
Female 76
Turban 67.4
Headband 67.4
Girl 60.3
Flooring 57.5
Hat 54.8

Imagga
created on 2022-01-23

child 32.3
man 31.7
kin 30.2
people 30.1
male 29.3
person 26.4
couple 26.1
father 22.3
happy 20.7
family 20.5
happiness 20.4
adult 20
beach 19.4
love 18.9
mother 18.9
outdoors 16.4
lifestyle 15.9
portrait 15.5
parent 15.5
dad 15.4
smiling 15.2
home 15.2
together 14.9
relaxing 14.6
daughter 14.3
joy 14.2
two 13.6
old 13.2
summer 12.9
smile 12.8
dress 11.8
romantic 11.6
vacation 11.5
fun 11.2
sea 10.9
world 10.6
bride 10.6
grandfather 10.5
life 10.4
boy 10.4
sitting 10.3
day 10.2
house 10
water 10
son 10
face 9.9
holding 9.9
sunset 9.9
sand 9.9
groom 9.6
relaxed 9.4
senior 9.4
casual 9.3
ocean 9.1
lady 8.9
looking 8.8
room 8.8
holiday 8.6
husband 8.6
men 8.6
scholar 8.5
laughing 8.5
relationship 8.4
mature 8.4
leisure 8.3
wedding 8.3
alone 8.2
cheerful 8.1
coast 8.1
romance 8
cute 7.9
parents 7.8
attractive 7.7
married 7.7
walking 7.6
fashion 7.5
camera 7.4
20s 7.3
playing 7.3
sun 7.2
handsome 7.1
women 7.1
juvenile 7.1
sky 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

building 99.4
person 99
clothing 97.5
outdoor 93
man 86.6
text 83.8
footwear 78.6
old 78.2
vintage 25.3

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Female, 78.1%
Calm 67.4%
Sad 22%
Confused 4.3%
Angry 1.8%
Disgusted 1.5%
Surprised 1.3%
Fear 1.2%
Happy 0.5%

AWS Rekognition

Age 36-44
Gender Male, 99%
Calm 98.9%
Sad 0.8%
Confused 0.1%
Disgusted 0%
Happy 0%
Fear 0%
Angry 0%
Surprised 0%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 84.5%
Sad 10.8%
Angry 1.3%
Confused 1.3%
Disgusted 0.8%
Surprised 0.6%
Happy 0.5%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 92.5%
Calm 53.7%
Sad 32.3%
Fear 3.9%
Angry 3.8%
Disgusted 3.3%
Happy 1.3%
Confused 1.2%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Hat 54.8%

Captions

Microsoft

a vintage photo of a man sitting on a bench 92.3%
a vintage photo of a man and a woman sitting on a bench 85.2%
a vintage photo of a man and woman sitting on a bench 83.5%