Human Generated Data

Title

Untitled (St. Joseph's High School for Girls)
Date

1951, printed later
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.390

Human Generated Data

Title

Untitled (St. Joseph's High School for Girls)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1951, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.4
Person 99.4
Clothing 98.9
Apparel 98.9
Person 98.8
Person 98.6
Person 96.6
Person 95.3
Person 90.9
Tree 90.2
Plant 90.2
Person 85.6
Robe 81
Fashion 81
Gown 77.4
Female 74.9
Person 74.9
Wedding 74.4
Person 74.2
Person 71.1
People 70.8
Person 70.5
Fir 68.6
Abies 68.6
Conifer 63.5
Crowd 62.6
Woman 61.6
Wedding Gown 59
Evening Dress 57.4
Person 50.5
Person 44.9

Imagga
created on 2022-01-08

picket fence 100
fence 100
barrier 86.3
obstruction 57.2
structure 28.9
cemetery 20.8
park 19.7
tree 16.9
old 16
couple 14.8
bride 14.4
architecture 14
building 13.6
dress 13.5
grass 13.4
outdoors 13.4
travel 13.4
trees 13.3
wedding 12.9
groom 12.6
landscape 12.6
garden 12.6
people 12.3
summer 12.2
history 11.6
flowers 11.3
wall 11.2
winter 11.1
historic 11
forest 10.4
man 10.1
rural 9.7
scene 9.5
love 9.5
brick 9.4
two 9.3
church 9.2
snow 9.2
street 9.2
outdoor 9.2
city 9.1
countryside 9.1
religion 9
light 8.7
war 8.7
day 8.6
happiness 8.6
sunny 8.6
season 8.6
house 8.4
sky 8.3
adult 8.2
scenery 8.1
women 7.9
country 7.9
statue 7.8
male 7.8
palace 7.7
married 7.7
marriage 7.6
plant 7.5
gown 7.3
new 7.3
sun 7.2
spring 7.1
autumn 7
scenic 7
together 7

Google
created on 2022-01-08

Plant 94.8
Dress 89.9
Tree 87.5
Black-and-white 84.1
Suit 76.9
Monochrome photography 74.8
Vintage clothing 74.6
Monochrome 72.6
Event 72.3
Formal wear 71.6
Classic 71.5
Room 68.6
History 65.1
Photo caption 62.2
Plantation 61.2
Pole 57.4
Uniform 56.7
Window 56.3
House 56.2
Retro style 55.6

Microsoft
created on 2022-01-08

tree 99.8
outdoor 98.5
wedding dress 91.5
person 85
bride 84.4
text 81
clothing 75.9
white 75.3
woman 74
dress 56.3
wedding 53.9

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 82%
Sad 39.4%
Calm 34.5%
Confused 12.3%
Fear 4.5%
Angry 4.1%
Surprised 1.8%
Happy 1.8%
Disgusted 1.6%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 94.2%
Confused 2.4%
Sad 1.6%
Disgusted 0.6%
Happy 0.5%
Angry 0.4%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Male, 95.6%
Calm 90.6%
Happy 7.6%
Disgusted 0.7%
Confused 0.4%
Surprised 0.3%
Angry 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Female, 99.9%
Calm 45.6%
Sad 34.3%
Angry 8.6%
Fear 4%
Confused 3.5%
Surprised 1.9%
Disgusted 1.4%
Happy 0.7%

AWS Rekognition

Age 24-34
Gender Female, 100%
Happy 96.6%
Calm 2.3%
Sad 0.3%
Confused 0.2%
Fear 0.2%
Surprised 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 13-21
Gender Female, 96.7%
Sad 32.3%
Confused 15.3%
Fear 13.9%
Calm 12.8%
Happy 8.5%
Disgusted 6.4%
Angry 6.1%
Surprised 4.8%

AWS Rekognition

Age 19-27
Gender Female, 93.4%
Calm 40.3%
Fear 12.4%
Surprised 11.3%
Confused 10.6%
Disgusted 9%
Happy 7.6%
Angry 4.8%
Sad 4.1%

AWS Rekognition

Age 34-42
Gender Female, 99.7%
Calm 99.2%
Sad 0.4%
Confused 0.2%
Angry 0.1%
Disgusted 0%
Happy 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 18-24
Gender Male, 67.9%
Confused 68.4%
Calm 24.6%
Sad 4.7%
Angry 0.9%
Disgusted 0.4%
Surprised 0.4%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Female, 99.9%
Calm 90.5%
Confused 2.7%
Sad 2%
Angry 1.8%
Surprised 1.1%
Disgusted 0.8%
Happy 0.7%
Fear 0.4%

AWS Rekognition

Age 29-39
Gender Female, 99.6%
Calm 89.6%
Sad 3.2%
Surprised 2.6%
Angry 1.5%
Fear 1.4%
Disgusted 1.1%
Confused 0.4%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Male, 51.1%
Fear 79.4%
Calm 6.7%
Disgusted 6.3%
Confused 2.4%
Surprised 1.8%
Angry 1.6%
Sad 1.2%
Happy 0.5%

AWS Rekognition

Age 7-17
Gender Female, 57.4%
Happy 74.2%
Sad 8%
Calm 5.3%
Disgusted 4.4%
Angry 4.1%
Surprised 1.7%
Confused 1.3%
Fear 1.1%

AWS Rekognition

Age 16-24
Gender Female, 99.6%
Sad 60.1%
Calm 17%
Angry 10.3%
Confused 5.6%
Disgusted 2.2%
Fear 1.8%
Happy 1.5%
Surprised 1.5%

AWS Rekognition

Age 30-40
Gender Female, 100%
Sad 97.6%
Calm 1.5%
Disgusted 0.3%
Confused 0.3%
Happy 0.1%
Fear 0.1%
Angry 0.1%
Surprised 0%

AWS Rekognition

Age 18-26
Gender Male, 99.4%
Sad 77%
Confused 10.9%
Calm 4.9%
Angry 4.1%
Disgusted 1.2%
Fear 0.8%
Happy 0.6%
Surprised 0.5%

AWS Rekognition

Age 18-24
Gender Female, 79.8%
Calm 37.8%
Fear 18.5%
Happy 13.2%
Disgusted 12.1%
Confused 7.2%
Sad 6.3%
Surprised 3.1%
Angry 1.9%

AWS Rekognition

Age 16-22
Gender Female, 91.5%
Sad 30.9%
Happy 20.3%
Surprised 13.4%
Disgusted 12%
Angry 8.9%
Calm 5.7%
Confused 5.3%
Fear 3.5%

AWS Rekognition

Age 18-26
Gender Female, 99.9%
Calm 44.5%
Sad 16.9%
Fear 15.3%
Confused 7.5%
Disgusted 4.7%
Angry 4.2%
Happy 4%
Surprised 3%

AWS Rekognition

Age 16-22
Gender Female, 66.3%
Sad 42.4%
Fear 29.7%
Calm 9.4%
Surprised 6.8%
Confused 5.5%
Disgusted 4%
Angry 1.7%
Happy 0.5%

AWS Rekognition

Age 23-31
Gender Female, 77.3%
Calm 78.4%
Sad 13.8%
Fear 2.7%
Happy 1.5%
Angry 1.1%
Disgusted 1%
Confused 0.9%
Surprised 0.6%

AWS Rekognition

Age 11-19
Gender Female, 94.3%
Calm 67%
Fear 11.6%
Angry 8.4%
Sad 5.9%
Surprised 2%
Happy 1.8%
Confused 1.6%
Disgusted 1.5%

AWS Rekognition

Age 23-31
Gender Female, 99.7%
Calm 79.4%
Happy 6%
Confused 3.9%
Sad 3.6%
Angry 3.6%
Disgusted 1.9%
Surprised 0.9%
Fear 0.7%

AWS Rekognition

Age 16-22
Gender Male, 87.4%
Calm 97.8%
Sad 0.5%
Confused 0.5%
Surprised 0.5%
Fear 0.4%
Happy 0.2%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 38-46
Gender Female, 54.1%
Fear 72.7%
Calm 11.9%
Sad 9.2%
Happy 1.6%
Confused 1.4%
Angry 1.2%
Disgusted 1%
Surprised 1%

AWS Rekognition

Age 12-20
Gender Female, 97.1%
Calm 52.9%
Angry 18.4%
Happy 7.8%
Disgusted 6.6%
Fear 5.7%
Surprised 4.3%
Sad 2.4%
Confused 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people standing in front of a building 84.2%
a person standing in front of a building 82.5%
a group of people walking in front of a building 82.4%