Human Generated Data

Title

Untitled (birthday party, Manchester, New Hampshire)

Date

1931, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.85

Human Generated Data

Title

Untitled (birthday party, Manchester, New Hampshire)

People

Artist: Durette Studio, American 20th century

Date

1931, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.1
Human 99.1
Person 98.8
Person 97.5
Person 97.2
Monitor 97.1
Display 97.1
Electronics 97.1
Screen 97.1
Person 96.7
Person 96.3
Person 94.7
Person 92.9
Person 92.8
Person 81.2
People 81
Face 80.4
Person 78.8
Person 74.7
Person 74.2
Person 72
Indoors 69.1
Interior Design 69.1
Head 65.6
Person 62.8
Crowd 59.5

Imagga
created on 2021-12-14

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 99.8
monitor 94.8
person 90.4
television 88.6
clothing 86.8
woman 81.6
screen 78.8
man 67.9
black 66.3
old 61.5
image 32.8
store 31.2
sale 15

Face analysis

Amazon

Google

AWS Rekognition

Age 4-14
Gender Male, 78.5%
Calm 97.2%
Happy 1.3%
Sad 0.5%
Angry 0.3%
Surprised 0.3%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 11-21
Gender Female, 86.3%
Calm 93.6%
Sad 2.6%
Angry 2.5%
Happy 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 2-8
Gender Female, 76.6%
Happy 86.8%
Calm 10.4%
Fear 0.9%
Sad 0.6%
Surprised 0.5%
Angry 0.4%
Confused 0.3%
Disgusted 0.1%

AWS Rekognition

Age 4-12
Gender Female, 93.8%
Calm 94.4%
Sad 2.3%
Angry 0.9%
Happy 0.8%
Surprised 0.6%
Confused 0.4%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 7-17
Gender Female, 91.1%
Calm 96.2%
Happy 2.5%
Sad 0.3%
Disgusted 0.3%
Angry 0.3%
Surprised 0.2%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 5-15
Gender Female, 94.4%
Calm 70.7%
Happy 20.8%
Surprised 3.1%
Sad 1.6%
Fear 1.5%
Angry 1.2%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 5-15
Gender Female, 95.6%
Happy 94.8%
Calm 2.3%
Surprised 0.8%
Confused 0.6%
Angry 0.5%
Disgusted 0.5%
Sad 0.3%
Fear 0.3%

AWS Rekognition

Age 5-15
Gender Female, 71.8%
Calm 74%
Happy 23.3%
Sad 0.7%
Angry 0.7%
Surprised 0.5%
Disgusted 0.4%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 3-9
Gender Female, 96.5%
Happy 98.4%
Calm 1.2%
Sad 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 29-45
Gender Female, 98.2%
Calm 99.4%
Happy 0.3%
Angry 0.1%
Sad 0.1%
Surprised 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 2-8
Gender Female, 99.4%
Calm 95%
Surprised 1.5%
Happy 1.2%
Sad 0.8%
Fear 0.7%
Disgusted 0.5%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 3-11
Gender Female, 92.2%
Happy 99.2%
Calm 0.5%
Surprised 0.1%
Sad 0%
Fear 0%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 3-11
Gender Female, 87.7%
Calm 98.9%
Surprised 0.3%
Sad 0.3%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 3-9
Gender Female, 71.9%
Calm 89.9%
Happy 5.7%
Sad 1.3%
Confused 1.2%
Angry 0.5%
Surprised 0.5%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 3-9
Gender Male, 91.5%
Calm 99%
Happy 0.4%
Sad 0.3%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 4-14
Gender Female, 84%
Calm 86.5%
Happy 6.9%
Angry 1.9%
Sad 1.7%
Surprised 0.9%
Disgusted 0.9%
Confused 0.7%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Monitor 97.1%

Captions

Microsoft

a group of people standing in front of a television screen 61.8%
a group of people standing in front of a television 61.7%
a crowd of people standing in front of a television screen 61.6%

Text analysis

Amazon

17
New
George
1931
George Durette Studio
Manchester, New Hampshire
200
Durette
Hampshire
Studio
08
Manchester,
82.5%

Google

Studio
New
08
200
17 825% George Durette Studio Manchester, New Hampshire 1931 08 200
825%
Durette
Manchester,
Hampshire
1931
17
George