Human Generated Data

Title

Untitled (bride and groom standing with several adults and children on sidewalk with boy in foreground)

Date

1951

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9172

Human Generated Data

Title

Untitled (bride and groom standing with several adults and children on sidewalk with boy in foreground)

People

Artist: Martin Schweig, American 20th century

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.4
Human 99.4
Person 99.3
Person 99.2
Apparel 99.2
Clothing 99.2
Person 99.1
Person 98.7
Person 98.5
Person 98.5
Person 97.9
Vehicle 94.3
Car 94.3
Transportation 94.3
Automobile 94.3
Accessory 90.4
Tie 90.4
Accessories 90.4
Female 86.8
Footwear 85
Shoe 85
Shorts 81.6
Car 79.7
People 78.2
Car 77.9
Wheel 76.9
Machine 76.9
Face 73
Woman 67.1
Dress 65.2
Girl 64.6
Kid 64.1
Child 64.1
Suit 60.9
Coat 60.9
Overcoat 60.9
Photo 59.7
Photography 59.7
Building 57.7
Crowd 57.1
Shoe 56

Imagga
created on 2022-01-23

man 30.2
sport 26.1
people 21.7
male 21.3
world 20.2
athlete 17.6
business 17
city 16.6
active 16.6
stage 16
ball 15.9
person 15.5
competition 14.6
fitness 14.5
outdoors 14.3
men 13.7
play 12.9
playing 12.8
weapon 12.7
exercise 12.7
platform 12.2
adult 11.7
vehicle 11.6
lifestyle 11.6
travel 11.3
fun 11.2
court 10.7
training 10.2
player 10.1
leisure 10
outdoor 9.9
transportation 9.9
game 9.8
summer 9.6
equipment 9.5
club 9.4
work 9.4
boat 9.4
industry 9.4
sword 9.3
transport 9.1
holding 9.1
black 9
recreation 9
ship 8.8
building 8.8
water 8.7
sea 8.6
professional 8.6
walking 8.5
power 8.4
action 8.3
street 8.3
team 8.1
worker 8
urban 7.9
tennis 7.8
construction 7.7
sky 7.7
car 7.6
guy 7.4
sports 7.4
body 7.2
activity 7.2

Google
created on 2022-01-23

Black 89.7
Dress 89.1
Vehicle 87.7
Motor vehicle 85.8
Black-and-white 82.1
Car 76.6
Monochrome 76.4
Monochrome photography 76.4
Snapshot 74.3
Hat 72.8
Tire 72.6
Suit 71.7
Toddler 71.6
Vintage clothing 71.4
Classic 68.4
Event 65.9
Wheel 65.2
Stock photography 65.1
Room 65.1
History 63.1

Microsoft
created on 2022-01-23

text 98.8
person 97.1
black and white 94.7
outdoor 92.1
street 88.3
clothing 81.1
monochrome 70.3
people 59.3
vehicle 52.3
car 50.5

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 81%
Calm 92.3%
Sad 7.4%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Female, 58.2%
Calm 92.8%
Angry 1.9%
Happy 1.7%
Surprised 1.5%
Confused 1.4%
Disgusted 0.4%
Sad 0.2%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Female, 84.3%
Calm 94%
Surprised 3.5%
Happy 1.1%
Disgusted 0.5%
Confused 0.4%
Sad 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 69.5%
Calm 87.7%
Happy 8.7%
Sad 2.1%
Surprised 0.6%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Car 94.3%
Tie 90.4%
Shoe 85%
Wheel 76.9%

Captions

Microsoft

a group of people posing for a photo 88%
a group of people posing for the camera 87.9%
a group of people standing around a bus 67.2%

Text analysis

Amazon

EA
YТ378-АX
1820

Google

YT37A2-XAGO
YT37A2-XAGO