Human Generated Data

Title

Untitled (spectators)
Date

c. 1920
People

Artist: Joseph Woodson Whitesell, American 1876 - 1958
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1705

Human Generated Data

Title

Untitled (spectators)

People

Artist: Joseph Woodson Whitesell, American 1876 - 1958

Date

c. 1920

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1705

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Human 99
Person 99
Person 98.8
Person 98.5
Person 98.5
Person 96.7
Person 94.6
Person 94.4
Person 92.3
Bench 91.1
Furniture 91.1
Person 90.7
Person 89.8
Person 89
Person 87.6
Crowd 87.4
Person 87
Person 86.7
People 83.2
Outdoors 80.7
Person 80.1
Audience 77.6
Person 74.2
Person 73.5
Person 73.1
Apparel 71.4
Clothing 71.4
Person 71
Nature 70.3
Countryside 69.9
Person 65.8
Chair 64.7
Person 63.6
Building 63.3
Funeral 59.1
Hut 57.5
Rural 57.5
Shack 57.5
Military Uniform 57.1
Military 57.1
Person 51.7

Clarifai
created on 2023-10-25

people 99.9
many 99.6
group together 98.7
group 98.6
child 96.3
adult 95.6
recreation 94.2
man 94
war 89.9
woman 89.4
military 88.9
spectator 88.8
uniform 87.5
bench 87.4
several 87.2
wear 86.2
education 85.9
boy 85.4
crowd 83.7
furniture 82.5

Imagga
created on 2022-01-14

brass 100
wind instrument 80
musical instrument 55.7
cornet 26.3
people 25.1
trombone 24.2
man 24.2
group 20.9
male 19.8
silhouette 19
person 18.6
men 18
adult 15.8
team 13.4
baritone 12.5
businessman 12.3
business 12.1
bugle 12.1
teamwork 11.1
sunset 10.8
photographer 10.6
music 10.5
boy 10.4
play 10.3
sport 10
girls 10
hand 9.9
black 9.6
grass 9.5
training 9.2
outdoor 9.2
competition 9.1
uniform 8.9
sky 8.9
crowd 8.6
meeting 8.5
field 8.4
event 8.3
professional 8.2
game 8
women 7.9
together 7.9
run 7.7
summer 7.7
youth 7.7
happy 7.5
fun 7.5
executive 7.4
active 7.3
protection 7.3
device 7.2
suit 7.2
shadow 7.2
family 7.1
work 7.1

Google
created on 2022-01-14

Headgear 82.7
Crew 73.6
Vintage clothing 73.5
Suit 73
Event 69.2
Team 68.7
History 66.2
Sitting 63.5
Art 61.2
Monochrome 58
Monochrome photography 56.8
Crowd 51.9
Motor vehicle 51.4
Retro style 51.2
Recreation 50.5
Uniform 50.3

Microsoft
created on 2022-01-14

person 99.4
clothing 93.9
man 88.3
group 87.8
people 78.5
footwear 66.1
old 47.1
posing 41.3
crowd 0.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Female, 70%
Calm 66.1%
Sad 22%
Disgusted 4.3%
Fear 2.9%
Surprised 1.3%
Confused 1.2%
Angry 1.1%
Happy 1%

AWS Rekognition

Age 24-34
Gender Female, 96.8%
Calm 79.1%
Sad 5.1%
Angry 4.3%
Confused 3.5%
Disgusted 3.2%
Surprised 2.2%
Happy 1.5%
Fear 1%

AWS Rekognition

Age 18-26
Gender Female, 99.4%
Happy 97.4%
Disgusted 0.7%
Surprised 0.6%
Calm 0.3%
Angry 0.3%
Fear 0.3%
Sad 0.2%
Confused 0.2%

AWS Rekognition

Age 42-50
Gender Female, 83%
Fear 78%
Calm 15.2%
Sad 2.1%
Happy 1.9%
Angry 1.1%
Disgusted 0.9%
Surprised 0.5%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Female, 66.6%
Calm 79.4%
Confused 9.4%
Angry 4.4%
Disgusted 2.5%
Sad 2.4%
Fear 1%
Surprised 0.7%
Happy 0.4%

AWS Rekognition

Age 19-27
Gender Female, 100%
Surprised 47.3%
Happy 39.3%
Fear 9.1%
Angry 1.6%
Confused 1.5%
Calm 0.6%
Disgusted 0.5%
Sad 0.2%

AWS Rekognition

Age 20-28
Gender Male, 98.4%
Calm 74.8%
Sad 17.2%
Angry 3.3%
Confused 1.9%
Happy 1.1%
Disgusted 0.8%
Surprised 0.6%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Female, 93.9%
Calm 42.5%
Disgusted 22.8%
Confused 13.7%
Fear 9.5%
Surprised 3.5%
Sad 3.3%
Angry 2.5%
Happy 2.3%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 94.6%
Happy 2.1%
Sad 1.8%
Confused 0.4%
Disgusted 0.4%
Angry 0.2%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 20-28
Gender Female, 99.4%
Happy 57.2%
Calm 15%
Fear 14.3%
Angry 5.9%
Surprised 2.7%
Sad 2%
Confused 1.7%
Disgusted 1.2%

AWS Rekognition

Age 23-33
Gender Male, 99.6%
Calm 72.3%
Angry 26.3%
Sad 0.4%
Surprised 0.3%
Happy 0.3%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 11-19
Gender Female, 73.8%
Surprised 99.6%
Calm 0.1%
Fear 0.1%
Angry 0.1%
Sad 0%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 20-28
Gender Female, 99.5%
Calm 78.7%
Happy 19.4%
Sad 0.7%
Fear 0.5%
Angry 0.4%
Disgusted 0.2%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 37-45
Gender Female, 99.7%
Sad 93.8%
Calm 5.5%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0%
Surprised 0%

AWS Rekognition

Age 23-31
Gender Male, 82.1%
Happy 34.7%
Calm 29.8%
Surprised 17.3%
Angry 7.5%
Fear 6.1%
Disgusted 2%
Confused 1.5%
Sad 1.2%

AWS Rekognition

Age 23-33
Gender Female, 96.6%
Happy 99.1%
Sad 0.5%
Angry 0.1%
Surprised 0.1%
Calm 0.1%
Fear 0.1%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 28-38
Gender Female, 89.8%
Calm 79.1%
Sad 11.6%
Angry 4.4%
Disgusted 2%
Fear 1.2%
Confused 0.6%
Surprised 0.6%
Happy 0.4%

AWS Rekognition

Age 21-29
Gender Male, 64.9%
Calm 52.7%
Disgusted 16.2%
Sad 11.1%
Angry 6.9%
Confused 5%
Surprised 3.4%
Happy 3.2%
Fear 1.4%

AWS Rekognition

Age 12-20
Gender Female, 65.5%
Sad 88.9%
Happy 3.8%
Disgusted 2.7%
Fear 2.3%
Calm 1%
Surprised 0.6%
Angry 0.5%
Confused 0.2%

AWS Rekognition

Age 18-26
Gender Male, 96.2%
Calm 56.1%
Angry 20.5%
Surprised 10.4%
Sad 4.1%
Fear 4%
Confused 2.2%
Disgusted 1.9%
Happy 0.8%

AWS Rekognition

Age 23-33
Gender Male, 98%
Calm 38.1%
Fear 12.9%
Angry 12.9%
Sad 12.2%
Disgusted 7.5%
Confused 6.4%
Surprised 5.1%
Happy 4.9%

AWS Rekognition

Age 25-35
Gender Female, 96.8%
Calm 89.2%
Fear 3.3%
Sad 2.2%
Surprised 1.7%
Angry 1.5%
Confused 0.8%
Happy 0.8%
Disgusted 0.5%

AWS Rekognition

Age 11-19
Gender Female, 96%
Calm 59.4%
Sad 11.7%
Happy 10.9%
Fear 6.1%
Angry 5.7%
Disgusted 2.7%
Surprised 1.9%
Confused 1.7%

AWS Rekognition

Age 16-24
Gender Female, 92.2%
Surprised 25%
Happy 22.7%
Disgusted 20.7%
Angry 17.2%
Fear 6.4%
Calm 4.7%
Confused 1.9%
Sad 1.3%

AWS Rekognition

Age 24-34
Gender Male, 97.9%
Calm 64%
Happy 10.5%
Fear 5.5%
Sad 4.9%
Surprised 4.8%
Confused 3.8%
Angry 3.4%
Disgusted 3.2%

AWS Rekognition

Age 16-24
Gender Male, 96.9%
Happy 37.7%
Sad 30.2%
Calm 16.5%
Angry 8%
Disgusted 3%
Surprised 2.3%
Confused 1.7%
Fear 0.6%

AWS Rekognition

Age 18-24
Gender Female, 88.3%
Calm 79.5%
Sad 13%
Angry 2%
Happy 1.7%
Surprised 1.2%
Fear 1%
Confused 0.9%
Disgusted 0.6%

AWS Rekognition

Age 11-19
Gender Male, 53.2%
Fear 77.7%
Sad 17.1%
Calm 2.9%
Happy 0.8%
Confused 0.5%
Disgusted 0.4%
Surprised 0.4%
Angry 0.3%

AWS Rekognition

Age 20-28
Gender Male, 65.3%
Calm 60.5%
Sad 20%
Disgusted 7.1%
Fear 3.8%
Happy 3.2%
Surprised 2.7%
Angry 1.9%
Confused 0.7%

AWS Rekognition

Age 2-8
Gender Male, 68%
Calm 95.7%
Sad 1.5%
Happy 0.7%
Confused 0.7%
Angry 0.5%
Disgusted 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 99.5%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Confused 0.1%
Sad 0.1%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 19-27
Gender Female, 86.1%
Happy 99.7%
Calm 0.1%
Surprised 0.1%
Angry 0.1%
Sad 0%
Fear 0%
Confused 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99%
Bench 91.1%