Human Generated Data

Title

Untitled (group of children in front of school bus)

Date

1956

People

Artist: Samuel Cooper, American active 1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19558

Human Generated Data

Title

Untitled (group of children in front of school bus)

People

Artist: Samuel Cooper, American active 1950s

Date

1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.8
Person 99.8
Person 99.8
Person 99.4
Person 98.9
Person 98.8
Person 98.7
Apparel 92.8
Clothing 92.8
Shorts 91.4
Bus 90.6
Vehicle 90.6
Transportation 90.6
Person 90.1
Person 89.6
Wheel 89.2
Machine 89.2
Person 88
People 84.2
Person 81.7
Military 73.1
Person 71.7
Outdoors 70.4
Military Uniform 70.4
Pants 67.1
Van 64.8
Army 64.8
Armored 64.8
Person 64.1
Child 61.4
Kid 61.4
Food 60.7
Meal 60.7
Soldier 55.4
Train 52.3

Imagga
created on 2022-03-05

wheeled vehicle 34.9
streetcar 28.1
vehicle 26.1
conveyance 22.9
architecture 21.3
building 20.9
city 20.8
street 20.2
house 20.1
car 19.1
transportation 17.9
road 17.2
wagon 17
passenger 16.4
travel 16.2
urban 15.7
tramway 14.8
transport 14.6
sky 14
structure 13.1
bus 12.6
stall 12.1
trees 11.6
night 11.5
scene 11.2
old 11.1
station 11.1
tree 10
business 9.7
home 9.6
traffic 9.5
destination 9.3
dark 9.2
tourist 9.2
train 9
landscape 8.9
rural 8.8
shuttle bus 8.8
park 8.7
public transport 8.7
track 8.6
day 8.6
passenger car 8.6
window 8.5
people 8.4
historic 8.2
container 8.1
light 8
facility 7.8
public transit 7.7
culture 7.7
power 7.6
tourism 7.4
exterior 7.4
office 7.2
history 7.1
shuttle 7
scenic 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

outdoor 99.1
person 95.9
text 94.1
black and white 86.4
people 83.8
man 79
standing 79
clothing 71.5
white 70.3
group 69.1

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.6%
Calm 66.1%
Happy 27.7%
Sad 2.8%
Fear 2%
Angry 0.4%
Disgusted 0.3%
Surprised 0.3%
Confused 0.3%

AWS Rekognition

Age 30-40
Gender Female, 52.9%
Happy 50.6%
Calm 40.2%
Sad 2.6%
Surprised 2.3%
Disgusted 2.2%
Fear 0.8%
Angry 0.8%
Confused 0.4%

AWS Rekognition

Age 26-36
Gender Male, 62.2%
Calm 70.2%
Sad 12.4%
Fear 5.2%
Happy 3.7%
Surprised 3.1%
Confused 2.3%
Disgusted 1.9%
Angry 1.3%

AWS Rekognition

Age 42-50
Gender Male, 99.7%
Calm 75.1%
Fear 11.4%
Happy 9.7%
Sad 2.8%
Confused 0.4%
Disgusted 0.3%
Surprised 0.2%
Angry 0.2%

AWS Rekognition

Age 51-59
Gender Female, 99.4%
Happy 92.2%
Calm 6.7%
Confused 0.3%
Surprised 0.3%
Sad 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 24-34
Gender Male, 96.6%
Calm 35.9%
Happy 34.4%
Confused 16%
Sad 5.9%
Disgusted 3.3%
Angry 3%
Surprised 1%
Fear 0.6%

AWS Rekognition

Age 30-40
Gender Male, 77.2%
Calm 70.4%
Happy 10.7%
Confused 8%
Sad 5.4%
Angry 2.4%
Disgusted 1.4%
Surprised 1.3%
Fear 0.3%

AWS Rekognition

Age 20-28
Gender Female, 85.1%
Calm 99.8%
Happy 0.1%
Surprised 0%
Disgusted 0%
Sad 0%
Angry 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 23-33
Gender Male, 98.1%
Calm 96.3%
Happy 2%
Sad 0.8%
Confused 0.4%
Disgusted 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 26-36
Gender Male, 76.2%
Happy 91.5%
Calm 3.3%
Sad 2.9%
Fear 1%
Confused 0.5%
Disgusted 0.3%
Angry 0.3%
Surprised 0.2%

AWS Rekognition

Age 26-36
Gender Male, 99.7%
Sad 58.4%
Confused 24.8%
Calm 14%
Happy 0.9%
Disgusted 0.7%
Fear 0.5%
Surprised 0.5%
Angry 0.2%

AWS Rekognition

Age 34-42
Gender Male, 70.5%
Calm 88.4%
Happy 3.4%
Confused 2.1%
Fear 1.6%
Surprised 1.3%
Sad 1.2%
Angry 1%
Disgusted 0.9%

AWS Rekognition

Age 26-36
Gender Female, 51.8%
Happy 75.8%
Calm 19.1%
Sad 1.8%
Disgusted 1%
Confused 0.7%
Fear 0.7%
Surprised 0.5%
Angry 0.4%

AWS Rekognition

Age 23-31
Gender Male, 98.3%
Calm 40.6%
Happy 32.4%
Sad 8.1%
Confused 5.5%
Surprised 4.7%
Disgusted 3.6%
Fear 3.3%
Angry 1.9%

AWS Rekognition

Age 37-45
Gender Male, 81.2%
Calm 85.2%
Happy 13.8%
Disgusted 0.3%
Confused 0.2%
Surprised 0.2%
Sad 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 79.5%
Calm 84.2%
Sad 5.3%
Happy 3.3%
Disgusted 2%
Surprised 1.8%
Confused 1.7%
Angry 1.3%
Fear 0.4%

AWS Rekognition

Age 26-36
Gender Female, 52.7%
Happy 97.4%
Calm 1.3%
Confused 0.9%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Calm 66%
Happy 21.2%
Sad 6.8%
Confused 3.1%
Surprised 1.4%
Disgusted 0.6%
Angry 0.5%
Fear 0.4%

AWS Rekognition

Age 21-29
Gender Male, 81.6%
Calm 95.6%
Sad 4.1%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 41-49
Gender Male, 95.9%
Happy 79.7%
Calm 13.3%
Surprised 2.2%
Disgusted 1.5%
Sad 1.2%
Angry 0.9%
Fear 0.7%
Confused 0.5%

AWS Rekognition

Age 24-34
Gender Female, 94.5%
Calm 87.3%
Happy 6.4%
Sad 5%
Fear 0.7%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Bus 90.6%
Wheel 89.2%
Train 52.3%

Captions

Microsoft

a vintage photo of a group of people standing in front of a building 96.8%
a group of people standing in front of a building 96.7%
a vintage photo of a group of people standing outside of a building 96.3%

Text analysis

Amazon

SCHOOL
MAIMONIDES
51988.
ROBOR--COVEEIX

Google

MAIMONIRES
MAIMONIRES