Human Generated Data

Title

Untitled (Jessie Tarbox Beals preparing to take photograph atop high ladder, main entrance of the Austrian Pavilion, 1904 St. Louis World's Fair)

Date

1904

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3162

Human Generated Data

Title

Untitled (Jessie Tarbox Beals preparing to take photograph atop high ladder, main entrance of the Austrian Pavilion, 1904 St. Louis World's Fair)

People

Artist: Unidentified Artist,

Date

1904

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3162

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.3
Human 99.3
Person 99.2
Person 97.8
Person 97.1
Person 96.8
Symbol 96.3
Cross 96.3
Person 96
Person 90.8
Crucifix 90.7
Person 89.6
Tripod 78.5
Person 78.5
Person 75.1
Person 74
Person 73.5
Person 67.3
Interior Design 57.2
Indoors 57.2

Clarifai
created on 2023-10-25

people 100
group 98.8
child 98.2
group together 98.1
street 96.8
two 96.7
adult 96.1
three 94.4
many 94.3
man 92.8
administration 92.5
monochrome 91
wear 89.9
leader 89.9
art 89.7
woman 89.5
actor 89.1
several 88.3
boy 85.4
four 85.2

Imagga
created on 2022-01-08

architecture 37.9
guillotine 33.6
building 31.3
city 29.9
instrument of execution 29.3
device 25.7
church 25
instrument 24.6
travel 23.2
statue 23.2
old 21.6
history 21.5
tourism 19
monument 18.7
ancient 18.2
landmark 18.1
historic 17.4
world 16.8
sculpture 16.2
stone 16.2
religion 15.2
cathedral 15
famous 14.9
urban 14.9
town 14.8
buildings 13.2
sky 12.8
tourist 12.7
tower 12.5
street 12
place 11.2
medieval 10.5
art 10.4
construction 10.3
catholic 9.7
house 9.7
column 9.6
culture 9.4
structure 9.1
attraction 8.6
england 8.6
black 8.4
dark 8.3
exterior 8.3
night 8
worship 7.7
heritage 7.7
roof 7.6
window 7.6
cross 7.5
historical 7.5
facade 7.4
person 7.4
palace 7.3
detail 7.2
temple 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

building 99.7
outdoor 96.9
person 85.7
clothing 79.1
black and white 72.6
statue 68.5
music 57.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 98%
Disgusted 0.9%
Angry 0.4%
Confused 0.3%
Sad 0.2%
Surprised 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 12-20
Gender Male, 99.5%
Calm 59.8%
Angry 9.3%
Sad 8.9%
Surprised 6.4%
Confused 6.3%
Disgusted 3.8%
Fear 2.8%
Happy 2.7%

AWS Rekognition

Age 16-24
Gender Female, 90.8%
Sad 56.5%
Disgusted 25.5%
Happy 7.2%
Confused 3.6%
Surprised 2%
Fear 1.8%
Calm 1.8%
Angry 1.6%

AWS Rekognition

Age 22-30
Gender Male, 64.2%
Calm 79.4%
Sad 14.2%
Happy 2.9%
Confused 1%
Surprised 0.8%
Disgusted 0.7%
Fear 0.7%
Angry 0.3%

AWS Rekognition

Age 25-35
Gender Male, 90.7%
Sad 58.5%
Happy 31.5%
Fear 3%
Disgusted 2.1%
Angry 1.9%
Calm 1.3%
Surprised 0.9%
Confused 0.9%

AWS Rekognition

Age 22-30
Gender Male, 97%
Disgusted 55%
Calm 27.5%
Angry 5.9%
Sad 3.7%
Surprised 3.5%
Fear 2.2%
Confused 1.3%
Happy 0.7%

AWS Rekognition

Age 23-31
Gender Female, 99.2%
Calm 34.1%
Sad 31.2%
Disgusted 14.1%
Confused 13.5%
Surprised 2.2%
Angry 2.1%
Happy 1.7%
Fear 1.1%

AWS Rekognition

Age 10-18
Gender Male, 97.4%
Calm 48.3%
Disgusted 23.7%
Happy 11.7%
Sad 6.3%
Fear 4%
Confused 2.2%
Surprised 1.9%
Angry 1.9%

AWS Rekognition

Age 9-17
Gender Male, 68.8%
Calm 74.8%
Happy 10.1%
Angry 8.5%
Fear 3%
Disgusted 1.5%
Surprised 1%
Sad 0.7%
Confused 0.4%

AWS Rekognition

Age 21-29
Gender Female, 96.4%
Happy 78%
Calm 9.6%
Angry 3.4%
Disgusted 3.2%
Sad 2.7%
Fear 1.2%
Surprised 1.2%
Confused 0.7%

AWS Rekognition

Age 28-38
Gender Male, 99%
Calm 99.9%
Happy 0.1%
Disgusted 0%
Confused 0%
Sad 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 2-10
Gender Female, 74.8%
Calm 93.5%
Sad 3.8%
Happy 0.8%
Fear 0.6%
Surprised 0.4%
Disgusted 0.3%
Confused 0.3%
Angry 0.3%

AWS Rekognition

Age 41-49
Gender Male, 94.2%
Calm 55.1%
Sad 34.2%
Happy 2.5%
Confused 2.2%
Fear 1.9%
Surprised 1.5%
Angry 1.4%
Disgusted 1.2%

AWS Rekognition

Age 23-33
Gender Female, 69.3%
Calm 94.9%
Happy 3.1%
Sad 0.7%
Angry 0.3%
Confused 0.3%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Categories

Text analysis

Amazon

AUST

Google

AUST
AUST