Human Generated Data

Title

Untitled (men in white coats)

Date

c. 1950

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19769

Human Generated Data

Title

Untitled (men in white coats)

People

Artist: Unidentified Artist,

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.7
Person 99.7
Clothing 99.5
Apparel 99.5
Person 99.4
Person 99.4
Shorts 99.3
Person 99.3
Person 99
Person 98.5
Person 97.5
Person 97.3
Person 96.9
Person 85.4
Person 80.6
Furniture 79.5
Face 74.8
People 67.1
Photo 65.6
Photography 65.6
Portrait 65.6
Road 64.3
Chair 60.8
Female 60.5
Asphalt 59.8
Tarmac 59.8
Sailor Suit 57
Skirt 56.5
Pants 55.1

Imagga
created on 2022-03-05

silhouette 45.5
beach 36.6
sunset 35.1
man 33
people 31.2
ocean 24.4
sky 24.2
male 23.6
sea 23.5
water 21.4
kin 20.5
sun 19.3
wind instrument 18.8
group 18.5
together 18.4
person 18.2
men 18
summer 18
couple 17.4
vacation 17.2
sand 17
shore 16.7
dusk 15.3
relax 15.2
walking 15.2
musical instrument 14.4
outdoors 14.3
travel 14.1
brass 13.9
fun 13.5
evening 13.1
adult 12.6
active 12.4
sax 12.2
child 12.2
happy 11.9
coast 11.7
world 11.6
lifestyle 11.6
family 11.6
businessman 11.5
holiday 11.5
sport 11.4
boy 11.3
life 11.2
waves 11.1
love 11
walk 10.5
success 10.5
business 10.3
friendship 10.3
happiness 10.2
leisure 10
landscape 9.7
outline 9.5
friends 9.4
tropical 9.4
black 9.2
romantic 8.9
kid 8.9
sunny 8.6
youth 8.5
winter 8.5
two 8.5
clouds 8.5
sunrise 8.4
outdoor 8.4
tourism 8.3
peaceful 8.2
peace 8.2
horizon 8.1
recreation 8.1
romance 8
light 8
river 8
father 7.9
device 7.9
sundown 7.9
silhouettes 7.8
play 7.8
tourist 7.8
run 7.7
relaxation 7.5
spectator 7.5
island 7.3
calm 7.3
exercise 7.3
looking 7.2
team 7.2
shadow 7.2
women 7.1
work 7.1

Google
created on 2022-03-05

Clothing 98.7
Trousers 96.3
Shirt 94.3
Black 89.8
Black-and-white 85.7
Style 84
Font 82.5
Line 81.9
People 77.8
Monochrome 76.6
Crew 76.6
Monochrome photography 75.9
Collar 74.8
Vintage clothing 74.7
Snapshot 74.3
Team 72.6
Uniform 72.2
Event 71.7
Shorts 69.1
Room 67.4

Microsoft
created on 2022-03-05

text 99.3
clothing 95.8
man 92.6
person 90.4
standing 79.8
footwear 71.2
black and white 67.5
posing 66.6
smile 57.5
beach 51.2

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Calm 87%
Sad 11.8%
Surprised 0.3%
Happy 0.2%
Angry 0.2%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Male, 91.3%
Happy 57.1%
Surprised 28.5%
Sad 8.6%
Disgusted 2%
Confused 1.9%
Calm 0.9%
Angry 0.6%
Fear 0.5%

AWS Rekognition

Age 51-59
Gender Male, 100%
Surprised 30.1%
Happy 24.9%
Sad 19.4%
Calm 19.4%
Disgusted 1.9%
Confused 1.6%
Angry 1.5%
Fear 1.3%

AWS Rekognition

Age 26-36
Gender Male, 98.1%
Calm 96.7%
Happy 2.7%
Confused 0.2%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0%

AWS Rekognition

Age 26-36
Gender Male, 54.6%
Sad 38%
Calm 20.5%
Happy 19.6%
Confused 8.8%
Surprised 4.6%
Fear 3.9%
Disgusted 3.1%
Angry 1.4%

AWS Rekognition

Age 48-56
Gender Male, 99.8%
Calm 96.3%
Happy 1.5%
Sad 1.4%
Surprised 0.3%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 48-56
Gender Male, 89.9%
Happy 63.4%
Surprised 30.5%
Confused 1.9%
Calm 1.1%
Fear 1%
Sad 0.8%
Angry 0.7%
Disgusted 0.6%

AWS Rekognition

Age 36-44
Gender Female, 72.9%
Happy 98.3%
Calm 0.5%
Sad 0.5%
Surprised 0.2%
Confused 0.2%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.4%
Happy 94.3%
Fear 1.3%
Calm 1%
Angry 0.9%
Sad 0.8%
Surprised 0.8%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 48-56
Gender Male, 86.6%
Calm 77.4%
Happy 11.4%
Disgusted 3.6%
Sad 2.1%
Confused 1.8%
Angry 1.7%
Surprised 1.2%
Fear 0.8%

AWS Rekognition

Age 23-33
Gender Female, 55.3%
Sad 49%
Calm 32.5%
Confused 9.6%
Happy 4.5%
Angry 1.7%
Surprised 1%
Fear 0.9%
Disgusted 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Chair 60.8%

Captions

Microsoft

a group of people posing for a photo 95.8%
a group of people posing for the camera 95.7%
a group of people posing for a picture 95.6%

Text analysis

Amazon

OVLE