Human Generated Data

Title

Untitled (group of men in front of a tractor at fair)

Date

c.1954

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18169

Human Generated Data

Title

Untitled (group of men in front of a tractor at fair)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

c.1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Wheel 99.8
Machine 99.8
Person 98.9
Human 98.9
Person 98.6
Person 97.4
Person 97.3
Person 97.1
Person 96.7
Person 95.3
Tire 93.8
People 86.4
Building 80
Person 80
Architecture 73.4
Clock Tower 73.4
Tower 73.4
Spoke 69.7
Crowd 69.4
Airplane 69
Transportation 69
Aircraft 69
Vehicle 69
Car Wheel 67.8
Clothing 63.6
Apparel 63.6
Shorts 63.6
Chair 62.4
Furniture 62.4
Overcoat 55.5
Coat 55.5
Suit 55.5

Imagga
created on 2022-03-04

child 32.9
brass 28.3
people 22.3
wind instrument 21.3
person 19.8
man 17.5
kin 17.2
happy 16.9
male 16.6
fun 16.5
grass 15.8
happiness 15.7
portrait 15.5
face 14.9
musical instrument 14.7
love 14.2
summer 14.1
dress 13.5
couple 13.1
outdoor 13
clock 12.9
joy 12.5
family 12.4
tricycle 12.3
boy 12.2
men 12
adult 11.7
leisure 11.6
youth 11.1
relax 10.9
wheeled vehicle 10.8
cute 10.8
park 10.7
grunge 10.2
lifestyle 10.1
field 10
pretty 9.8
human 9.7
outdoors 9.7
women 9.5
smile 9.3
decoration 9.2
playing 9.1
attractive 9.1
cheerful 8.9
run 8.7
play 8.6
vehicle 8.6
casual 8.5
art 8.5
mother 8.4
head 8.4
parent 8.4
fashion 8.3
silhouette 8.3
freedom 8.2
teenager 8.2
sunset 8.1
sexy 8
rural 7.9
life 7.8
party 7.7
sport 7.7
sky 7.6
enjoyment 7.5
vintage 7.4
water 7.3
hand 7.3
smiling 7.2
body 7.2
little 7.1

Google
created on 2022-03-04

Microsoft
created on 2022-03-04

text 90.4
posing 57.7
black and white 54.9
old 42.4

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Happy 88%
Confused 3.4%
Surprised 2.7%
Angry 2.6%
Calm 1.6%
Disgusted 0.6%
Sad 0.5%
Fear 0.5%

AWS Rekognition

Age 34-42
Gender Male, 97.7%
Sad 99.1%
Confused 0.4%
Calm 0.2%
Angry 0.1%
Surprised 0.1%
Happy 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 51-59
Gender Male, 99.3%
Sad 86.4%
Confused 3.9%
Calm 3.3%
Angry 2.6%
Surprised 1.1%
Disgusted 1%
Happy 0.8%
Fear 0.8%

AWS Rekognition

Age 47-53
Gender Male, 99.7%
Calm 57.9%
Sad 14.7%
Happy 7.5%
Fear 6.6%
Confused 4.8%
Surprised 4.5%
Disgusted 2.7%
Angry 1.5%

AWS Rekognition

Age 40-48
Gender Male, 100%
Sad 49.3%
Calm 36.9%
Surprised 3.8%
Happy 3.5%
Disgusted 1.9%
Confused 1.8%
Angry 1.7%
Fear 1%

AWS Rekognition

Age 41-49
Gender Male, 99.6%
Happy 48%
Angry 17.9%
Surprised 14.1%
Sad 6.1%
Calm 5.6%
Confused 5.3%
Disgusted 2.6%
Fear 0.5%

AWS Rekognition

Age 54-64
Gender Female, 82.9%
Surprised 67.3%
Happy 15.9%
Calm 10.8%
Sad 2.5%
Confused 1.2%
Fear 0.8%
Disgusted 0.8%
Angry 0.7%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 93%
Sad 1.6%
Confused 1.6%
Happy 1.1%
Fear 1%
Angry 0.7%
Surprised 0.6%
Disgusted 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Wheel 99.8%
Person 98.9%
Clock Tower 73.4%
Airplane 69%
Chair 62.4%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 84.5%
a vintage photo of a group of people posing for a picture 84.4%
a group of people posing for a photo 82.7%

Text analysis

Amazon

LARG
TRUCK
FARM
MALL
MCCORMICK
: MCCORMICK
:
rap
ARMALL
A
AU
KODAK-

Google

FARM
YT33A2-XACO
TRUCK
LARG
TRUCK LARG FARM FARM YT33A2-XACO