Human Generated Data

Title

Untitled (workmen, West African Lighter and Transport Co.)

Date

1910s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3172

Human Generated Data

Title

Untitled (workmen, West African Lighter and Transport Co.)

People

Artist: Unidentified Artist,

Date

1910s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.7
Human 98.7
Person 98.1
Person 97.8
Person 95.8
Person 94.2
Person 93.8
Person 90.4
Train Track 90
Rail 90
Railway 90
Transportation 90
Person 85.5
Person 83.3
Person 82.5
Person 79.6
Apparel 79.4
Clothing 79.4
Person 77.8
Person 75.6
Person 75
Person 69.7
Person 65.6
Vehicle 65.4
Person 64.4
Person 64.2
Wood 63.9
Nature 63.9
Hardhat 62.9
Helmet 62.9
Building 62.8
People 58.9
Person 57.2
Construction 56.9
Crowd 56
Person 54.6
Person 53
Person 52.8

Imagga
created on 2022-01-08

snow 59.4
winter 31.5
building 27.8
structure 26.4
weather 25.2
cold 24.1
old 23.7
landscape 22.3
architecture 22.2
house 19.5
sky 19.3
vintage 19
trees 16.9
graffito 16.8
rural 16.8
wheeled vehicle 16.5
travel 16.2
tree 15.4
grunge 14.5
scenery 13.5
wood 13.3
season 13.3
city 12.5
outdoor 12.2
forest 12.2
antique 12.1
vehicle 12.1
history 11.6
window 11.5
scenic 11.4
decoration 11.3
wall 11.2
retro 10.7
old fashioned 10.5
scene 10.4
ice 10.2
light 10
water 10
tourism 9.9
mobile home 9.9
river 9.8
rustic 9.6
ancient 9.5
empty 9.5
construction 9.4
paper 9.4
exterior 9.2
rough 9.1
park 9.1
texture 9
road 9
religion 9
roof 9
snowy 8.8
housing 8.7
frost 8.6
obsolete 8.6
car 8.6
culture 8.5
town 8.4
church 8.3
grain 8.3
street 8.3
landmark 8.1
trailer 8
wooden 7.9
holiday 7.9
frosty 7.8
cloud 7.8
frozen 7.6
conveyance 7.6
frame 7.5
countryside 7.3
aged 7.2
dirty 7.2
drawing 7.1
country 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

old 90
outdoor 88.3
ship 84.2
white 60.5
sky 57.7
house 53

Face analysis

Amazon

AWS Rekognition

Age 14-22
Gender Male, 95.4%
Calm 93.3%
Sad 2.4%
Happy 1.8%
Disgusted 1.3%
Surprised 0.5%
Confused 0.4%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 97.3%
Sad 0.7%
Surprised 0.6%
Confused 0.5%
Disgusted 0.4%
Angry 0.2%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 97.8%
Calm 33.8%
Fear 33.6%
Happy 22.4%
Sad 3.6%
Surprised 1.9%
Disgusted 1.8%
Angry 1.6%
Confused 1.3%

AWS Rekognition

Age 11-19
Gender Male, 76.9%
Sad 50.9%
Calm 25.4%
Confused 9.3%
Angry 5.6%
Fear 4.1%
Happy 2.9%
Disgusted 1.1%
Surprised 0.7%

AWS Rekognition

Age 16-24
Gender Male, 74.9%
Calm 56.2%
Fear 36.6%
Sad 1.8%
Disgusted 1.8%
Confused 1.6%
Surprised 1%
Angry 0.7%
Happy 0.4%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 68.1%
Sad 10.7%
Disgusted 5.4%
Angry 4.6%
Happy 4.3%
Confused 4%
Surprised 2%
Fear 0.9%

AWS Rekognition

Age 35-43
Gender Male, 87.1%
Calm 72.2%
Happy 12.6%
Sad 10.7%
Confused 1.5%
Disgusted 1.1%
Surprised 1%
Angry 0.6%
Fear 0.3%

AWS Rekognition

Age 2-8
Gender Male, 97.7%
Calm 72.9%
Confused 7.6%
Happy 5.3%
Sad 5.1%
Surprised 4.7%
Angry 2.3%
Disgusted 1.4%
Fear 0.7%

AWS Rekognition

Age 21-29
Gender Male, 90.8%
Calm 89.4%
Disgusted 4.2%
Happy 1.7%
Sad 1.7%
Angry 1.3%
Surprised 1.1%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Happy 98.1%
Surprised 0.9%
Calm 0.5%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 16-22
Gender Male, 60.6%
Calm 88%
Fear 6.9%
Angry 2.2%
Confused 1.1%
Sad 0.7%
Disgusted 0.5%
Surprised 0.4%
Happy 0.2%

AWS Rekognition

Age 30-40
Gender Male, 96.3%
Happy 55.9%
Calm 24.7%
Confused 4.6%
Sad 4.4%
Disgusted 4%
Surprised 3.6%
Fear 1.7%
Angry 1%

AWS Rekognition

Age 24-34
Gender Male, 99.5%
Calm 76.2%
Sad 5.9%
Happy 4.3%
Fear 4.1%
Surprised 3.3%
Confused 2.7%
Angry 2.3%
Disgusted 1.2%

AWS Rekognition

Age 19-27
Gender Male, 98.4%
Sad 81.9%
Fear 7.3%
Calm 5%
Happy 1.7%
Angry 1.3%
Disgusted 1.3%
Confused 1%
Surprised 0.5%

AWS Rekognition

Age 16-22
Gender Male, 89%
Sad 41.8%
Calm 19.8%
Confused 19.6%
Surprised 8.7%
Angry 3.3%
Disgusted 3.2%
Happy 2.5%
Fear 1%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 93.3%
Sad 3%
Surprised 1.3%
Happy 0.9%
Angry 0.5%
Disgusted 0.4%
Fear 0.4%
Confused 0.2%

AWS Rekognition

Age 21-29
Gender Male, 95.5%
Disgusted 25.9%
Confused 23.4%
Fear 20.2%
Sad 16.7%
Angry 4.8%
Calm 4.4%
Surprised 2.9%
Happy 1.7%

AWS Rekognition

Age 12-20
Gender Female, 99.7%
Calm 87.3%
Disgusted 6%
Sad 2.7%
Confused 1.7%
Fear 0.9%
Angry 0.7%
Surprised 0.4%
Happy 0.2%

AWS Rekognition

Age 13-21
Gender Male, 100%
Sad 57.5%
Confused 15.7%
Calm 15%
Happy 4.8%
Fear 2.1%
Disgusted 1.7%
Surprised 1.6%
Angry 1.4%

AWS Rekognition

Age 16-22
Gender Male, 96.4%
Fear 70.5%
Sad 7.9%
Calm 7.5%
Happy 7.3%
Confused 2.2%
Disgusted 2.1%
Angry 1.6%
Surprised 0.9%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 32.4%
Surprised 24.1%
Sad 17.4%
Happy 13.1%
Confused 5.1%
Disgusted 5.1%
Angry 2.3%
Fear 0.6%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 85.7%
Surprised 5.6%
Sad 2.1%
Happy 1.9%
Confused 1.6%
Disgusted 1.4%
Angry 0.8%
Fear 0.8%

AWS Rekognition

Age 20-28
Gender Male, 100%
Happy 59.9%
Calm 28.9%
Disgusted 4.2%
Confused 2.7%
Sad 1.7%
Surprised 1.3%
Angry 0.8%
Fear 0.5%

AWS Rekognition

Age 14-22
Gender Male, 99.8%
Fear 83%
Calm 9.2%
Disgusted 3%
Sad 1.5%
Confused 1.4%
Angry 0.8%
Surprised 0.7%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Male, 99.7%
Calm 71.2%
Sad 13%
Surprised 4.5%
Happy 3%
Fear 3%
Disgusted 2.6%
Confused 1.4%
Angry 1.3%

AWS Rekognition

Age 21-29
Gender Female, 81.8%
Calm 49.3%
Disgusted 30.1%
Angry 7.7%
Surprised 6.6%
Sad 2.7%
Fear 1.5%
Confused 1.3%
Happy 0.9%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Calm 98.6%
Sad 0.4%
Confused 0.3%
Fear 0.3%
Disgusted 0.2%
Angry 0.1%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Female, 84.1%
Calm 94.1%
Happy 2.3%
Sad 1.5%
Disgusted 0.6%
Fear 0.5%
Confused 0.4%
Angry 0.3%
Surprised 0.2%

AWS Rekognition

Age 13-21
Gender Male, 51%
Calm 89.1%
Sad 4.8%
Fear 3.3%
Happy 1.2%
Angry 0.7%
Disgusted 0.4%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 18-24
Gender Male, 63.9%
Sad 96.1%
Calm 2.5%
Happy 0.6%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%

AWS Rekognition

Age 18-24
Gender Female, 53%
Sad 50.5%
Calm 46.6%
Angry 1%
Disgusted 0.6%
Happy 0.6%
Confused 0.3%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Male, 98.8%
Sad 31.2%
Angry 23.9%
Calm 18.6%
Disgusted 9%
Confused 6.3%
Fear 4.8%
Surprised 4.7%
Happy 1.6%

AWS Rekognition

Age 2-8
Gender Male, 75%
Calm 95.7%
Fear 2.7%
Sad 0.6%
Confused 0.3%
Angry 0.3%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 7-17
Gender Male, 86.9%
Calm 63.8%
Disgusted 15.8%
Sad 7.6%
Fear 3.8%
Angry 3.8%
Surprised 2%
Happy 2%
Confused 1.2%

AWS Rekognition

Age 19-27
Gender Female, 51.6%
Calm 98.2%
Confused 0.7%
Fear 0.6%
Happy 0.2%
Angry 0.1%
Sad 0.1%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 98.5%
Fear 60.3%
Calm 13%
Sad 10.8%
Surprised 4.9%
Disgusted 3.8%
Confused 3.5%
Happy 2.2%
Angry 1.5%

AWS Rekognition

Age 16-24
Gender Male, 96.6%
Calm 56.8%
Sad 31.4%
Angry 5%
Fear 2.4%
Disgusted 1.9%
Happy 1.1%
Confused 0.9%
Surprised 0.5%

AWS Rekognition

Age 13-21
Gender Male, 100%
Calm 45.5%
Surprised 27%
Fear 8.7%
Sad 7.7%
Disgusted 4%
Happy 2.7%
Confused 2.4%
Angry 2.1%

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a vintage photo of an old building 81.3%
a vintage photo of a group of people standing in front of a building 68.3%
a vintage photo of a group of people standing outside of a building 68.2%

Text analysis

Amazon

ORTC
& TRANSP ORTC
TRANSP
WESTAFRICANLICHTE
&

Google

WEST AFRICNLI &TRANSPORTE
WEST
AFRICNLI
&TRANSPORTE