Human Generated Data

Title

Untitled (cast of "HMS Pinafore" on stage)

Date

c. 1935

People

Artist: Curtis Studio, American active 1891 - 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13006

Human Generated Data

Title

Untitled (cast of "HMS Pinafore" on stage)

People

Artist: Curtis Studio, American active 1891 - 1935

Date

c. 1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 97.9
Human 97.9
Person 97.7
Person 97.6
Person 96.9
Person 96.6
Person 95.7
Person 93
Person 90.9
Person 90.4
Person 90.2
People 88.9
Person 87.5
Person 85.1
Stage 81.9
Person 78.7
Shop 76.4
Crowd 72.3
Person 69.8
Person 67.5
Person 64.6
Window Display 60

Imagga
created on 2022-02-05

case 100
architecture 24.2
building 17.6
window 15.1
shop 14.2
urban 14
old 13.9
house 13.4
city 13.3
interior 13.2
light 12.7
business 12.1
travel 11.2
people 11.1
art 11
design 10.1
transportation 9.8
home 9.6
historic 9.2
modern 9.1
night 8.9
mercantile establishment 8.7
decoration 8.7
glass 8.7
water 8.7
structure 8.6
vintage 8.3
reflection 8.1
history 8
black 7.8
scene 7.8
office 7.7
construction 7.7
culture 7.7
industry 7.7
sky 7.6
chair 7.6
outdoors 7.5
street 7.3
transport 7.3
bright 7.1

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

wedding dress 96.5
dress 94.1
group 90
window 88.5
person 88.4
clothing 88.2
bride 86.7
people 85.1
furniture 80.3
text 78.6
woman 73.1
dance 71

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 52.1%
Sad 75.3%
Calm 11.5%
Happy 5%
Angry 2.1%
Fear 1.9%
Disgusted 1.6%
Confused 1.4%
Surprised 1.2%

AWS Rekognition

Age 31-41
Gender Male, 81.2%
Sad 73.1%
Calm 16.7%
Confused 4.1%
Happy 1.9%
Disgusted 1.4%
Surprised 1%
Angry 1%
Fear 0.8%

AWS Rekognition

Age 43-51
Gender Male, 96.7%
Calm 55%
Happy 20.7%
Sad 18.4%
Confused 2.2%
Angry 1%
Surprised 1%
Disgusted 0.9%
Fear 0.7%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 82.3%
Sad 3.9%
Surprised 3.5%
Fear 3.4%
Angry 2.6%
Happy 2.2%
Disgusted 1.3%
Confused 0.8%

AWS Rekognition

Age 21-29
Gender Male, 98%
Calm 44%
Sad 31%
Confused 11.2%
Disgusted 3.9%
Happy 3.8%
Angry 3%
Surprised 2%
Fear 1.1%

AWS Rekognition

Age 4-12
Gender Male, 99.7%
Calm 74.4%
Sad 15.9%
Confused 6.4%
Happy 1.3%
Disgusted 0.5%
Surprised 0.5%
Fear 0.5%
Angry 0.5%

AWS Rekognition

Age 23-33
Gender Male, 95.1%
Calm 91%
Sad 7.1%
Confused 0.5%
Surprised 0.4%
Fear 0.3%
Angry 0.3%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 47-53
Gender Male, 99.4%
Happy 84.2%
Calm 9.3%
Sad 3.3%
Disgusted 1.2%
Fear 0.7%
Confused 0.7%
Angry 0.4%
Surprised 0.3%

AWS Rekognition

Age 48-56
Gender Male, 99.7%
Calm 73.7%
Sad 14.8%
Happy 8.7%
Confused 0.8%
Surprised 0.6%
Angry 0.5%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 43-51
Gender Male, 63.3%
Calm 95.7%
Sad 2.8%
Surprised 0.9%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 13-21
Gender Male, 76.2%
Sad 64.1%
Calm 19.5%
Fear 4.6%
Angry 3.3%
Disgusted 2.8%
Happy 2.5%
Confused 2.2%
Surprised 1%

AWS Rekognition

Age 40-48
Gender Male, 100%
Sad 81.6%
Confused 6.7%
Happy 3.9%
Calm 3.1%
Disgusted 1.7%
Angry 1.4%
Fear 1%
Surprised 0.6%

AWS Rekognition

Age 43-51
Gender Female, 59.3%
Calm 67.6%
Happy 12%
Sad 9.7%
Angry 3.2%
Fear 3.2%
Confused 1.5%
Disgusted 1.5%
Surprised 1.3%

AWS Rekognition

Age 24-34
Gender Male, 68.1%
Sad 91.2%
Calm 4.1%
Surprised 1.8%
Confused 1%
Fear 0.8%
Disgusted 0.4%
Angry 0.4%
Happy 0.4%

AWS Rekognition

Age 22-30
Gender Male, 87.9%
Sad 95.6%
Confused 3.1%
Calm 0.7%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 21-29
Gender Female, 61%
Happy 64.6%
Sad 13.3%
Calm 11.9%
Fear 3%
Disgusted 3%
Angry 2.3%
Surprised 1%
Confused 0.9%

AWS Rekognition

Age 26-36
Gender Female, 96%
Sad 61.9%
Happy 34.6%
Angry 0.9%
Confused 0.8%
Calm 0.6%
Disgusted 0.6%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 22-30
Gender Male, 99.6%
Calm 88.2%
Sad 8.2%
Confused 1.1%
Disgusted 0.7%
Happy 0.6%
Angry 0.5%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 43-51
Gender Male, 98.7%
Calm 56.6%
Happy 21%
Sad 14.1%
Surprised 2.8%
Confused 1.9%
Fear 1.6%
Disgusted 1.1%
Angry 0.7%

AWS Rekognition

Age 24-34
Gender Male, 99.1%
Sad 51.3%
Calm 22.3%
Happy 13.8%
Confused 8%
Disgusted 1.7%
Angry 1.6%
Surprised 0.8%
Fear 0.5%

AWS Rekognition

Age 33-41
Gender Female, 89.7%
Calm 52%
Sad 44.1%
Confused 1.6%
Happy 1.3%
Angry 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 12-20
Gender Female, 93.2%
Sad 56%
Calm 13.1%
Happy 10.6%
Angry 5.6%
Confused 4.1%
Fear 3.8%
Disgusted 3.7%
Surprised 3%

AWS Rekognition

Age 25-35
Gender Male, 69.5%
Calm 88.2%
Sad 9.5%
Confused 0.6%
Disgusted 0.5%
Angry 0.5%
Happy 0.4%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 26-36
Gender Male, 71.8%
Calm 96.3%
Happy 1.5%
Sad 1.4%
Surprised 0.2%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 97.9%

Captions

Microsoft

a group of people standing in front of a window 91.2%
a group of people standing next to a window 91.1%
a group of people standing in front of a crowd 90.8%

Text analysis

Amazon

as
<<P/